• It's recommended to check out the latest log via: the Stats page >> View log >> Tail

PROJECT (sourcing_v2), SPIDER (auto1.es)

2025-12-05 17:00:07 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 17:00:07 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 17:00:07 [auto1.es] INFO: Starting spider auto1.es
2025-12-05 17:00:07 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 17:00:07 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 17:00:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 17:00:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 17:00:07 [scrapy.extensions.telnet] INFO: Telnet Password: 2128e64668004002
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 17:00:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_25_2025-12-05T17_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 17:00:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 17:00:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 17:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 17:00:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 17:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:08 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 17:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 17:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 17:00:08 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 17:00:08 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 17:00:08 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 17:00:08 [scrapy.core.engine] INFO: Spider opened
2025-12-05 17:00:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 17:00:08 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-05 17:00:08 [scrapy-playwright] INFO: Starting download handler
2025-12-05 17:00:08 [scrapy-playwright] INFO: Starting download handler
2025-12-05 17:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2025-12-05 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2025-12-05 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2025-12-05 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2025-12-05 17:00:18 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: YT08561
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT08561%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for YT08561: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: KG10310
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG10310%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for KG10310: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: SA98496
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA98496%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for SA98496: 0
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: CF14055
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF14055%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for CF14055: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: XW54610
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW54610%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for XW54610: 0
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: BK83112
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK83112%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for BK83112: 0
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: DH78566
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH78566%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for DH78566: 0
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: SX04596
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX04596%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for SX04596: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: ZP94659
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP94659%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for ZP94659: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: RJ00036
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ00036%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for RJ00036: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: ME74462
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME74462%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for ME74462: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: NS56171
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS56171%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for NS56171: 0
2025-12-05 17:00:18 [auto1.es] INFO: Found listing with ID: WG87489
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG87489%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.es] INFO: Scrape type for WG87489: 1
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: JS40239
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS40239%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for JS40239: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: SE60665
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE60665%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for SE60665: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: CJ15310
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ15310%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for CJ15310: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: TH56833
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH56833%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for TH56833: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: RD05990
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD05990%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for RD05990: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: VL02192
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL02192%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for VL02192: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: MH03440
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH03440%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for MH03440: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: FN26416
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN26416%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for FN26416: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: JW09669
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW09669%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for JW09669: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: XR81231
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR81231%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for XR81231: 1
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: VV72496
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV72496%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for VV72496: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: RE25433
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE25433%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for RE25433: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: KL03697
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL03697%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for KL03697: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: PD43946
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD43946%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for PD43946: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: UF98248
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98248%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for UF98248: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: WT74540
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT74540%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for WT74540: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: ZU14629
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU14629%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for ZU14629: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: LK91240
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK91240%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for LK91240: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: SM82482
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM82482%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for SM82482: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: UL45578
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL45578%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for UL45578: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: XZ95413
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ95413%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for XZ95413: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: LZ24799
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ24799%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for LZ24799: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: DW62963
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW62963%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for DW62963: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: NY35740
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35740%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for NY35740: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: CH80864
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH80864%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for CH80864: 2
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: AS17231
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS17231%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for AS17231: 0
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: WH22103
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH22103%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for WH22103: 0
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT08561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX04596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF14055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP94659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME74462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: YT08561
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT08561%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.es] INFO: Scrape type for YT08561: 2
2025-12-05 17:00:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/YT08561/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2025-12-05 17:00:19 [auto1.es] INFO: Found listing with ID: KG10310
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG10310%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for KG10310: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: SA98496
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA98496%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for SA98496: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: CF14055
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF14055%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for CF14055: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: XW54610
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW54610%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for XW54610: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: BK83112
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK83112%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for BK83112: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: DH78566
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH78566%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for DH78566: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: SX04596
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX04596%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for SX04596: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: ZP94659
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP94659%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for ZP94659: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ00036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: RJ00036
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ00036%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for RJ00036: 2
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: ME74462
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME74462%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for ME74462: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: NS56171
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS56171%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for NS56171: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: WG87489
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: JS40239
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS40239%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for JS40239: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: SE60665
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE60665%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for SE60665: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: CJ15310
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ15310%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for CJ15310: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: TH56833
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH56833%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for TH56833: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: RD05990
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD05990%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for RD05990: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: VL02192
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL02192%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for VL02192: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: MH03440
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH03440%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for MH03440: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: FN26416
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN26416%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for FN26416: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG10310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: JW09669
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW09669%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for JW09669: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: XR81231
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: VV72496
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV72496%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for VV72496: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: RE25433
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE25433%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for RE25433: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG87489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE60665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: KL03697
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL03697%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for KL03697: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: PD43946
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD43946%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for PD43946: 2
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: UF98248
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98248%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for UF98248: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: WT74540
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT74540%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for WT74540: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: ZU14629
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU14629%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for ZU14629: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: LK91240
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK91240%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for LK91240: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: SM82482
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM82482%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for SM82482: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: UL45578
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL45578%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for UL45578: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: XZ95413
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ95413%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for XZ95413: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: LZ24799
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ24799%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for LZ24799: 2
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: DW62963
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW62963%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for DW62963: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: NY35740
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35740%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for NY35740: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH03440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: CH80864
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH80864%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for CH80864: 2
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: AS17231
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS17231%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for AS17231: 0
2025-12-05 17:00:20 [auto1.es] INFO: Found listing with ID: WH22103
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH22103%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.es] INFO: Scrape type for WH22103: 0
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN26416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR81231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD43946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY35740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF98248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH80864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ24799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF14055> (referer: https://www.auto1.com/v1/car-details-view/CF14055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX04596> (referer: https://www.auto1.com/v1/car-details-view/SX04596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c759661-cc1e-5e4f-be69-0bc242305172 with identifier: CF14055
2025-12-05 17:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c759661-cc1e-5e4f-be69-0bc242305172 with scrape type 2
2025-12-05 17:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c759661-cc1e-5e4f-be69-0bc242305172 with scrape type 2
2025-12-05 17:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c759661-cc1e-5e4f-be69-0bc242305172, identifier: CF14055
2025-12-05 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c759661-cc1e-5e4f-be69-0bc242305172 with identifier: CF14055
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2025-12-05 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2025-12-05 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c759661-cc1e-5e4f-be69-0bc242305172 with identifier: CF14055
2025-12-05 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 198823 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198823
2025-12-05 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2c759661-cc1e-5e4f-be69-0bc242305172 spider: auto1.es
2025-12-05 17:00:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2c759661-cc1e-5e4f-be69-0bc242305172 due to rule: high_mileage_for_country.json, error: 198823 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198823
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:38:37Z',
 'fuel_type': 'diesel',
 'id': '2c759661-cc1e-5e4f-be69-0bc242305172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF14055',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 198823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF14055%27 HTTP/1.1" 200 None
2025-12-05 17:00:23 [auto1.es] INFO: Saving data for CF14055: {'auction_closing_time': 1765039117.0, 'created_time': 1764240273.675219, 'last_price_update_time': 1764954023.148546}
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CF14055') HTTP/1.1" 204 0
2025-12-05 17:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT08561> (referer: https://www.auto1.com/v1/car-details-view/YT08561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME74462> (referer: https://www.auto1.com/v1/car-details-view/ME74462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ00036> (referer: https://www.auto1.com/v1/car-details-view/RJ00036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32462f4f-5f02-5652-ac81-f3d0eacb4a93 with identifier: SX04596
2025-12-05 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32462f4f-5f02-5652-ac81-f3d0eacb4a93 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32462f4f-5f02-5652-ac81-f3d0eacb4a93 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 32462f4f-5f02-5652-ac81-f3d0eacb4a93, identifier: SX04596
2025-12-05 17:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 32462f4f-5f02-5652-ac81-f3d0eacb4a93 with identifier: SX04596
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2025-12-05 17:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2025-12-05 17:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 32462f4f-5f02-5652-ac81-f3d0eacb4a93 with identifier: SX04596
2025-12-05 17:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 32462f4f-5f02-5652-ac81-f3d0eacb4a93 with identifier: SX04596 to the API
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX04596>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:12:31Z',
 'fuel_type': 'petrol',
 'id': '32462f4f-5f02-5652-ac81-f3d0eacb4a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX04596',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 95703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX04596%27 HTTP/1.1" 200 None
2025-12-05 17:00:24 [auto1.es] INFO: Saving data for SX04596: {'auction_closing_time': 1765037551.0, 'created_time': 1762668043.256364, 'last_price_update_time': 1764954024.083063}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SX04596') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561
2025-12-05 17:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c96392-ea24-5330-8a9a-670364abdbf0 with scrape type 2
2025-12-05 17:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c96392-ea24-5330-8a9a-670364abdbf0 with scrape type 2
2025-12-05 17:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f8c96392-ea24-5330-8a9a-670364abdbf0, identifier: YT08561
2025-12-05 17:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e0c444-fb31-55ee-8a8c-3aa1530720fb with identifier: ME74462
2025-12-05 17:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e0c444-fb31-55ee-8a8c-3aa1530720fb with scrape type 2
2025-12-05 17:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e0c444-fb31-55ee-8a8c-3aa1530720fb with scrape type 2
2025-12-05 17:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90e0c444-fb31-55ee-8a8c-3aa1530720fb, identifier: ME74462
2025-12-05 17:00:24 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c103688a-f4ff-5607-928f-338927b93e30 with identifier: RJ00036
2025-12-05 17:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c103688a-f4ff-5607-928f-338927b93e30 with scrape type 2
2025-12-05 17:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c103688a-f4ff-5607-928f-338927b93e30 with scrape type 2
2025-12-05 17:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c103688a-f4ff-5607-928f-338927b93e30, identifier: RJ00036
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561
2025-12-05 17:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561 to the API
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT08561>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:28:46Z',
 'fuel_type': 'diesel',
 'id': 'f8c96392-ea24-5330-8a9a-670364abdbf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT08561',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 97593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT08561%27 HTTP/1.1" 200 None
2025-12-05 17:00:24 [auto1.es] INFO: Saving data for YT08561: {'auction_closing_time': 1765038526.0, 'created_time': 1763704946.907174, 'last_price_update_time': 1764954024.960416}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YT08561') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90e0c444-fb31-55ee-8a8c-3aa1530720fb with identifier: ME74462
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2025-12-05 17:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90e0c444-fb31-55ee-8a8c-3aa1530720fb with identifier: ME74462
2025-12-05 17:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90e0c444-fb31-55ee-8a8c-3aa1530720fb with identifier: ME74462 to the API
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME74462>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:28:54Z',
 'fuel_type': 'diesel',
 'id': '90e0c444-fb31-55ee-8a8c-3aa1530720fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME74462',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 131267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 30 TDI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME74462%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Saving data for ME74462: {'auction_closing_time': 1765038534.0, 'created_time': 1762275749.150894, 'last_price_update_time': 1764954026.382032}
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ME74462') HTTP/1.1" 204 0
2025-12-05 17:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c103688a-f4ff-5607-928f-338927b93e30 with identifier: RJ00036
2025-12-05 17:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c103688a-f4ff-5607-928f-338927b93e30 with identifier: RJ00036
2025-12-05 17:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165102 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165102
2025-12-05 17:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c103688a-f4ff-5607-928f-338927b93e30 spider: auto1.es
2025-12-05 17:00:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c103688a-f4ff-5607-928f-338927b93e30 due to rule: high_mileage_for_country.json, error: 165102 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165102
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:00:13Z',
 'fuel_type': 'diesel',
 'id': 'c103688a-f4ff-5607-928f-338927b93e30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ00036',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 165102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Essence 2WD',
 'transmission': 'manual',
 'trim': 'Essence 2WD',
 'year': 2019}
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ00036%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Saving data for RJ00036: {'auction_closing_time': 1765036813.0, 'created_time': 1759492195.119333, 'last_price_update_time': 1764954026.617082}
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RJ00036') HTTP/1.1" 204 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: FX30462
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX30462%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for FX30462: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: JP70912
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP70912%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for JP70912: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: BH93590
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH93590%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for BH93590: 2
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE60665> (referer: https://www.auto1.com/v1/car-details-view/SE60665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG87489> (referer: https://www.auto1.com/v1/car-details-view/WG87489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: RS43600
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS43600%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for RS43600: 2
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE25433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP94659> (referer: https://www.auto1.com/v1/car-details-view/ZP94659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: XE24275
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE24275%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for XE24275: 2
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: ZU68613
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU68613%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for ZU68613: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: NB31576
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB31576%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for NB31576: 2
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: PN18739
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN18739%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for PN18739: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: ZJ25086
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ25086%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for ZJ25086: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: EB74275
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB74275%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for EB74275: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: AD74551
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD74551%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for AD74551: 0
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: RA99155
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA99155%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for RA99155: 2
2025-12-05 17:00:26 [auto1.es] INFO: Found listing with ID: DY41462
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY41462%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.es] INFO: Scrape type for DY41462: 2
2025-12-05 17:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7987b061-e541-5929-9d69-7ef24f38e5a4 with identifier: SE60665
2025-12-05 17:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7987b061-e541-5929-9d69-7ef24f38e5a4 with scrape type 2
2025-12-05 17:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7987b061-e541-5929-9d69-7ef24f38e5a4 with scrape type 2
2025-12-05 17:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7987b061-e541-5929-9d69-7ef24f38e5a4, identifier: SE60665
2025-12-05 17:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93660625-fa4c-57cc-a5a3-eb0111f4fcba with identifier: WG87489
2025-12-05 17:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba with scrape type 1
2025-12-05 17:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg not downloaded yet
2025-12-05 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f97de42d-51af-59ba-a7be-b8b201fbfd9a with identifier: ZP94659
2025-12-05 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f97de42d-51af-59ba-a7be-b8b201fbfd9a with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f97de42d-51af-59ba-a7be-b8b201fbfd9a with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f97de42d-51af-59ba-a7be-b8b201fbfd9a, identifier: ZP94659
2025-12-05 17:00:27 [auto1.es] INFO: Found listing with ID: FR76525
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR76525%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [auto1.es] INFO: Scrape type for FR76525: 2
2025-12-05 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7987b061-e541-5929-9d69-7ef24f38e5a4 with identifier: SE60665
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2025-12-05 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7987b061-e541-5929-9d69-7ef24f38e5a4 with identifier: SE60665
2025-12-05 17:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7987b061-e541-5929-9d69-7ef24f38e5a4 with identifier: SE60665 to the API
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE60665>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:58:21Z',
 'fuel_type': 'hybrid',
 'id': '7987b061-e541-5929-9d69-7ef24f38e5a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE60665',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 70458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Tech',
 'transmission': 'automatic',
 'trim': '2WD Active Tech',
 'year': 2021}
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE60665%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [auto1.es] INFO: Saving data for SE60665: {'auction_closing_time': 1765040301.0, 'created_time': 1764850039.536446, 'last_price_update_time': 1764954027.636457}
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SE60665') HTTP/1.1" 204 0
2025-12-05 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f97de42d-51af-59ba-a7be-b8b201fbfd9a with identifier: ZP94659
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2025-12-05 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f97de42d-51af-59ba-a7be-b8b201fbfd9a with identifier: ZP94659
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179335 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179335
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f97de42d-51af-59ba-a7be-b8b201fbfd9a spider: auto1.es
2025-12-05 17:00:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f97de42d-51af-59ba-a7be-b8b201fbfd9a due to rule: high_mileage_for_country.json, error: 179335 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179335
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:52:54Z',
 'fuel_type': 'diesel',
 'id': 'f97de42d-51af-59ba-a7be-b8b201fbfd9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP94659',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'BMW',
 'model': '4er',
 'odometer': 179335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP94659%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Saving data for ZP94659: {'auction_closing_time': 1765039974.0, 'created_time': 1761206533.056839, 'last_price_update_time': 1764954028.14305}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZP94659') HTTP/1.1" 204 0
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg not downloaded yet
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: GP33027
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP33027%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for GP33027: 2
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_09c649f446b586906caeea82c70053d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg not downloaded yet
2025-12-05 17:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD43946> (referer: https://www.auto1.com/v1/car-details-view/PD43946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH03440> (referer: https://www.auto1.com/v1/car-details-view/MH03440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY35740> (referer: https://www.auto1.com/v1/car-details-view/NY35740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN26416> (referer: https://www.auto1.com/v1/car-details-view/FN26416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: ST91933
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST91933%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for ST91933: 0
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: XX76249
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX76249%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for XX76249: 0
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: ZY46148
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY46148%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for ZY46148: 2
2025-12-05 17:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg not downloaded yet
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: ZU29675
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU29675%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for ZU29675: 0
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: TB34403
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB34403%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for TB34403: 2
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_eeb3abb21740d23da11f369dbeff4078.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg not downloaded yet
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: JD77898
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD77898%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for JD77898: 2
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_588edbc8f41f6bb375c7ac6a49888186.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg not downloaded yet
2025-12-05 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c9fb14f-a34b-559e-a2a4-ea147b86bc88 with identifier: PD43946
2025-12-05 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9fb14f-a34b-559e-a2a4-ea147b86bc88 with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c9fb14f-a34b-559e-a2a4-ea147b86bc88 with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c9fb14f-a34b-559e-a2a4-ea147b86bc88, identifier: PD43946
2025-12-05 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be85792-245f-5c46-9d6e-3e71f59d24a6 with identifier: MH03440
2025-12-05 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be85792-245f-5c46-9d6e-3e71f59d24a6 with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6be85792-245f-5c46-9d6e-3e71f59d24a6 with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6be85792-245f-5c46-9d6e-3e71f59d24a6, identifier: MH03440
2025-12-05 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740
2025-12-05 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ffbe907-9d14-5e26-99f6-12edbb319d17 with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ffbe907-9d14-5e26-99f6-12edbb319d17 with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ffbe907-9d14-5e26-99f6-12edbb319d17, identifier: NY35740
2025-12-05 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a with identifier: FN26416
2025-12-05 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a with scrape type 2
2025-12-05 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a, identifier: FN26416
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: KT49599
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT49599%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for KT49599: 0
2025-12-05 17:00:28 [auto1.es] INFO: Found listing with ID: CA58728
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA58728%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.es] INFO: Scrape type for CA58728: 2
2025-12-05 17:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c9fb14f-a34b-559e-a2a4-ea147b86bc88 with identifier: PD43946
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c9fb14f-a34b-559e-a2a4-ea147b86bc88 with identifier: PD43946
2025-12-05 17:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c9fb14f-a34b-559e-a2a4-ea147b86bc88 with identifier: PD43946 to the API
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PD43946>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:01:09Z',
 'fuel_type': 'diesel',
 'id': '0c9fb14f-a34b-559e-a2a4-ea147b86bc88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD43946',
 'listing': 'auction',
 'location': 'Finestrat, Alicante',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 90193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD43946%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.es] INFO: Saving data for PD43946: {'auction_closing_time': 1765036869.0, 'created_time': 1764762215.368963, 'last_price_update_time': 1764954029.140523}
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD43946') HTTP/1.1" 204 0
2025-12-05 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6be85792-245f-5c46-9d6e-3e71f59d24a6 with identifier: MH03440
2025-12-05 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6be85792-245f-5c46-9d6e-3e71f59d24a6 with identifier: MH03440
2025-12-05 17:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6be85792-245f-5c46-9d6e-3e71f59d24a6 with identifier: MH03440 to the API
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH03440>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:58:15Z',
 'fuel_type': 'petrol',
 'id': '6be85792-245f-5c46-9d6e-3e71f59d24a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH03440',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 73146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2020}
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH03440%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.es] INFO: Saving data for MH03440: {'auction_closing_time': 1765040295.0, 'created_time': 1764762370.57643, 'last_price_update_time': 1764954029.445874}
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MH03440') HTTP/1.1" 204 0
2025-12-05 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2025-12-05 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740
2025-12-05 17:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740 to the API
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY35740>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:29:54Z',
 'fuel_type': 'gas',
 'id': '0ffbe907-9d14-5e26-99f6-12edbb319d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY35740',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 1398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Expression +',
 'transmission': 'manual',
 'trim': 'Stepway Expression +',
 'year': 2025}
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35740%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Saving data for NY35740: {'auction_closing_time': 1765038594.0, 'created_time': 1761379269.644773, 'last_price_update_time': 1764954030.119126}
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY35740') HTTP/1.1" 204 0
2025-12-05 17:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a with identifier: FN26416
2025-12-05 17:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a with identifier: FN26416
2025-12-05 17:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f9ade6a-b649-5908-81e1-b36e9cd0ba9a with identifier: FN26416 to the API
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN26416>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:01:19Z',
 'fuel_type': 'petrol',
 'id': '8f9ade6a-b649-5908-81e1-b36e9cd0ba9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN26416',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 72294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Style Edition',
 'transmission': 'automatic',
 'trim': 'Style Edition',
 'year': 2019}
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN26416%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Saving data for FN26416: {'auction_closing_time': 1765036879.0, 'created_time': 1764762560.483184, 'last_price_update_time': 1764954030.438705}
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN26416') HTTP/1.1" 204 0
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_7e547dac98832551c3d9a6442c0aa783.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg not downloaded yet
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: RY15101
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15101%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for RY15101: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: WZ33081
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ33081%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for WZ33081: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: BW97423
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW97423%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for BW97423: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: RH39683
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH39683%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for RH39683: 2
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR81231> (referer: https://www.auto1.com/v1/car-details-view/XR81231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF98248> (referer: https://www.auto1.com/v1/car-details-view/UF98248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ24799> (referer: https://www.auto1.com/v1/car-details-view/LZ24799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH80864> (referer: https://www.auto1.com/v1/car-details-view/CH80864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_7f82cc8a26bc86698e2717ca5f140861.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg not downloaded yet
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: KT85047
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT85047%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for KT85047: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: EG04365
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG04365%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for EG04365: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: ZC59926
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC59926%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for ZC59926: 2
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_466bff717dcc04582d647e2b88f49579.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg not downloaded yet
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: EB69359
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB69359%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for EB69359: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: UC12674
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC12674%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for UC12674: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: KV22405
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV22405%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for KV22405: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: RV87659
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV87659%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for RV87659: 2
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_9dccacd072a539f61b5d84a52faecf75.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg not downloaded yet
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: JU85916
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU85916%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for JU85916: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: FF47469
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF47469%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for FF47469: 0
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: SS89996
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS89996%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for SS89996: 2
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg not downloaded yet
2025-12-05 17:00:30 [auto1.es] INFO: Found listing with ID: YJ95969
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ95969%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.es] INFO: Scrape type for YJ95969: 2
2025-12-05 17:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f1acce7-155b-530e-9083-7b4727e6dee9 with identifier: XR81231
2025-12-05 17:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1acce7-155b-530e-9083-7b4727e6dee9 with scrape type 1
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_2d7d349b13b229133106b858279f2308.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2d7d349b13b229133106b858279f2308.jpg not downloaded yet
2025-12-05 17:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26151a0a-3c5f-5ce3-bc1e-67492291df6a with identifier: UF98248
2025-12-05 17:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26151a0a-3c5f-5ce3-bc1e-67492291df6a with scrape type 2
2025-12-05 17:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26151a0a-3c5f-5ce3-bc1e-67492291df6a with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26151a0a-3c5f-5ce3-bc1e-67492291df6a, identifier: UF98248
2025-12-05 17:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84ca908-d88e-590a-a4bb-279d9cfdab77 with identifier: LZ24799
2025-12-05 17:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84ca908-d88e-590a-a4bb-279d9cfdab77 with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84ca908-d88e-590a-a4bb-279d9cfdab77 with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d84ca908-d88e-590a-a4bb-279d9cfdab77, identifier: LZ24799
2025-12-05 17:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6543a94-6ecf-5e08-891f-88df8d038898 with identifier: CH80864
2025-12-05 17:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6543a94-6ecf-5e08-891f-88df8d038898 with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6543a94-6ecf-5e08-891f-88df8d038898 with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6543a94-6ecf-5e08-891f-88df8d038898, identifier: CH80864
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_aff8c28f234b553fbf166e4b67b129c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg not downloaded yet
2025-12-05 17:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26151a0a-3c5f-5ce3-bc1e-67492291df6a with identifier: UF98248
2025-12-05 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26151a0a-3c5f-5ce3-bc1e-67492291df6a with identifier: UF98248
2025-12-05 17:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26151a0a-3c5f-5ce3-bc1e-67492291df6a with identifier: UF98248 to the API
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UF98248>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:18:48Z',
 'fuel_type': 'petrol',
 'id': '26151a0a-3c5f-5ce3-bc1e-67492291df6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF98248',
 'listing': 'auction',
 'location': 'ES, A Cañiza Pontevedra',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 121204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98248%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.es] INFO: Saving data for UF98248: {'auction_closing_time': 1765037928.0, 'created_time': 1764849601.202772, 'last_price_update_time': 1764954031.864433}
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF98248') HTTP/1.1" 204 0
2025-12-05 17:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d84ca908-d88e-590a-a4bb-279d9cfdab77 with identifier: LZ24799
2025-12-05 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d84ca908-d88e-590a-a4bb-279d9cfdab77 with identifier: LZ24799
2025-12-05 17:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d84ca908-d88e-590a-a4bb-279d9cfdab77 with identifier: LZ24799 to the API
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ24799>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-06T16:13:36Z',
 'fuel_type': 'diesel',
 'id': 'd84ca908-d88e-590a-a4bb-279d9cfdab77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ24799',
 'listing': 'auction',
 'location': 'Málaga',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 149187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2016}
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ24799%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.es] INFO: Saving data for LZ24799: {'auction_closing_time': 1765037616.0, 'created_time': 1764849736.264497, 'last_price_update_time': 1764954032.289697}
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ24799') HTTP/1.1" 204 0
2025-12-05 17:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6543a94-6ecf-5e08-891f-88df8d038898 with identifier: CH80864
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6543a94-6ecf-5e08-891f-88df8d038898 with identifier: CH80864
2025-12-05 17:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6543a94-6ecf-5e08-891f-88df8d038898 with identifier: CH80864 to the API
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CH80864>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2025-12-06T16:40:52Z',
 'fuel_type': 'petrol',
 'id': 'b6543a94-6ecf-5e08-891f-88df8d038898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH80864',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 97358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH80864%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.es] INFO: Saving data for CH80864: {'auction_closing_time': 1765039252.0, 'created_time': 1764762084.660765, 'last_price_update_time': 1764954032.753392}
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH80864') HTTP/1.1" 204 0
2025-12-05 17:00:32 [auto1.es] INFO: Found listing with ID: ZU85997
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU85997%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.es] INFO: Scrape type for ZU85997: 2
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_2c3f3a8fe2e68536dccc9bc8272adb17.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2c3f3a8fe2e68536dccc9bc8272adb17.jpg not downloaded yet
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg not downloaded yet
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU14629/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ95413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG10310> (referer: https://www.auto1.com/v1/car-details-view/KG10310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK91240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:32 [auto1.es] INFO: Found listing with ID: YG61507
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG61507%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.es] INFO: Scrape type for YG61507: 0
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_984c7f86a75724dc15d170b7f1b5a4e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_984c7f86a75724dc15d170b7f1b5a4e0.jpg not downloaded yet
2025-12-05 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_95f34092d3a7cba952cecab1bf0d429a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg not downloaded yet
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_b895b6d5fc52ddfaa908476b69717782.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_b895b6d5fc52ddfaa908476b69717782.jpg not downloaded yet
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg not downloaded yet
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_3abb329c7bdd6af696dd4018e9aa671a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_3abb329c7bdd6af696dd4018e9aa671a.jpg not downloaded yet
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_8581f74b2d57aab4e022fe604483c110.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg not downloaded yet
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_ae627a9b873b7ac61bb4d8fd2b6015ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_ae627a9b873b7ac61bb4d8fd2b6015ae.jpg not downloaded yet
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2c3f3a8fe2e68536dccc9bc8272adb17.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_83ecd43a74d119e371c3e4f7f69abe48.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_83ecd43a74d119e371c3e4f7f69abe48.jpg not downloaded yet
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7b8a50>
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg saved to cache
2025-12-05 17:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310
2025-12-05 17:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0caad4fe-b952-5f46-a607-4a35dc719925 with scrape type 2
2025-12-05 17:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0caad4fe-b952-5f46-a607-4a35dc719925 with scrape type 2
2025-12-05 17:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0caad4fe-b952-5f46-a607-4a35dc719925, identifier: KG10310
2025-12-05 17:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310
2025-12-05 17:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310
2025-12-05 17:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310 to the API
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG10310>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:28:35Z',
 'fuel_type': 'diesel',
 'id': '0caad4fe-b952-5f46-a607-4a35dc719925',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG10310',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 122611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super 2WD',
 'transmission': 'automatic',
 'trim': 'Super 2WD',
 'year': 2018}
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG10310%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.es] INFO: Saving data for KG10310: {'auction_closing_time': 1765038515.0, 'created_time': 1763985265.684996, 'last_price_update_time': 1764954033.748761}
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KG10310') HTTP/1.1" 204 0
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_67554f889aec302af32b2c7e0b842110.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_67554f889aec302af32b2c7e0b842110.jpg not downloaded yet
2025-12-05 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT74540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e1d90>
2025-12-05 17:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_588edbc8f41f6bb375c7ac6a49888186.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg saved to cache
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e689d50>
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_2c3f3a8fe2e68536dccc9bc8272adb17.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2c3f3a8fe2e68536dccc9bc8272adb17.jpg saved to cache
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_d0bd2006c20cb76155313d3949ac4f21.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_d0bd2006c20cb76155313d3949ac4f21.jpg not downloaded yet
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS43600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH93590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_ae627a9b873b7ac61bb4d8fd2b6015ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_f22b5e3c41e37f02ab73408e58141a1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_f22b5e3c41e37f02ab73408e58141a1f.jpg not downloaded yet
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e51b590>
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_7e547dac98832551c3d9a6442c0aa783.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg saved to cache
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5730d0>
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg saved to cache
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2d7d349b13b229133106b858279f2308.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_79b425511c53cfe8a5cc73ceaaaae121.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_79b425511c53cfe8a5cc73ceaaaae121.jpg not downloaded yet
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_83ecd43a74d119e371c3e4f7f69abe48.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_67554f889aec302af32b2c7e0b842110.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_66e0e3b3581f7d1a617bcc654f5c123e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_66e0e3b3581f7d1a617bcc654f5c123e.jpg not downloaded yet
2025-12-05 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e818490>
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_ae627a9b873b7ac61bb4d8fd2b6015ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_ae627a9b873b7ac61bb4d8fd2b6015ae.jpg saved to cache
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_9eceb822fe741fa05a624719d1fbed61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_9eceb822fe741fa05a624719d1fbed61.jpg not downloaded yet
2025-12-05 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_d0bd2006c20cb76155313d3949ac4f21.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_f22b5e3c41e37f02ab73408e58141a1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_57a39538ed2a6269c1b4f852d8691402.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_57a39538ed2a6269c1b4f852d8691402.jpg not downloaded yet
2025-12-05 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP33027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA58728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE25433> (referer: https://www.auto1.com/v1/car-details-view/RE25433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc2f10>
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_2d7d349b13b229133106b858279f2308.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2d7d349b13b229133106b858279f2308.jpg saved to cache
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb9ad0>
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_83ecd43a74d119e371c3e4f7f69abe48.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_83ecd43a74d119e371c3e4f7f69abe48.jpg saved to cache
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb27d0>
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_aff8c28f234b553fbf166e4b67b129c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg saved to cache
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbbe910>
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_67554f889aec302af32b2c7e0b842110.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_67554f889aec302af32b2c7e0b842110.jpg saved to cache
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:36 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_3abb329c7bdd6af696dd4018e9aa671a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_79b425511c53cfe8a5cc73ceaaaae121.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_de327eb2b356d499c4800ea5b40ab6bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_de327eb2b356d499c4800ea5b40ab6bd.jpg not downloaded yet
2025-12-05 17:00:36 [auto1.es] INFO: Found listing with ID: FB08932
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB08932%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [auto1.es] INFO: Scrape type for FB08932: 0
2025-12-05 17:00:36 [auto1.es] INFO: Found listing with ID: HB62611
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB62611%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [auto1.es] INFO: Scrape type for HB62611: 0
2025-12-05 17:00:36 [auto1.es] INFO: Found listing with ID: SG47067
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG47067%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [auto1.es] INFO: Scrape type for SG47067: 2
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD77898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ95969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU85997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR76525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5fe810>
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_d0bd2006c20cb76155313d3949ac4f21.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_d0bd2006c20cb76155313d3949ac4f21.jpg saved to cache
2025-12-05 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e678cd0>
2025-12-05 17:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_f22b5e3c41e37f02ab73408e58141a1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_f22b5e3c41e37f02ab73408e58141a1f.jpg saved to cache
2025-12-05 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0591882-ab24-57f8-9541-e45d5ad97dea with identifier: RE25433
2025-12-05 17:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0591882-ab24-57f8-9541-e45d5ad97dea with scrape type 2
2025-12-05 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0591882-ab24-57f8-9541-e45d5ad97dea with scrape type 2
2025-12-05 17:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d0591882-ab24-57f8-9541-e45d5ad97dea, identifier: RE25433
2025-12-05 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_9eceb822fe741fa05a624719d1fbed61.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_a73f7e24e9c75b66a03ff654a1ab7ab3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_a73f7e24e9c75b66a03ff654a1ab7ab3.jpg not downloaded yet
2025-12-05 17:00:37 [auto1.es] INFO: Found listing with ID: ZA34757
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA34757%27 HTTP/1.1" 200 None
2025-12-05 17:00:37 [auto1.es] INFO: Scrape type for ZA34757: 2
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d0591882-ab24-57f8-9541-e45d5ad97dea with identifier: RE25433
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d0591882-ab24-57f8-9541-e45d5ad97dea with identifier: RE25433
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195567 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195567
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d0591882-ab24-57f8-9541-e45d5ad97dea spider: auto1.es
2025-12-05 17:00:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d0591882-ab24-57f8-9541-e45d5ad97dea due to rule: high_mileage_for_country.json, error: 195567 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195567
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:24:21Z',
 'fuel_type': 'diesel',
 'id': 'd0591882-ab24-57f8-9541-e45d5ad97dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE25433',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 195567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2017}
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE25433%27 HTTP/1.1" 200 None
2025-12-05 17:00:37 [auto1.es] INFO: Saving data for RE25433: {'auction_closing_time': 1765038261.0, 'created_time': 1761386497.468568, 'last_price_update_time': 1764954037.569042}
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RE25433') HTTP/1.1" 204 0
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_66e0e3b3581f7d1a617bcc654f5c123e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_57a39538ed2a6269c1b4f852d8691402.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:37 [auto1.es] INFO: Found listing with ID: MJ10162
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ10162%27 HTTP/1.1" 200 None
2025-12-05 17:00:37 [auto1.es] INFO: Scrape type for MJ10162: 2
2025-12-05 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK91240> (referer: https://www.auto1.com/v1/car-details-view/LK91240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82c1d0>
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_3abb329c7bdd6af696dd4018e9aa671a.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_3abb329c7bdd6af696dd4018e9aa671a.jpg saved to cache
2025-12-05 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54ae50>
2025-12-05 17:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_79b425511c53cfe8a5cc73ceaaaae121.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_79b425511c53cfe8a5cc73ceaaaae121.jpg saved to cache
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54bb10>
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_8581f74b2d57aab4e022fe604483c110.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg saved to cache
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ad210>
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_9eceb822fe741fa05a624719d1fbed61.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_9eceb822fe741fa05a624719d1fbed61.jpg saved to cache
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:38 [auto1.es] INFO: Found listing with ID: MU81906
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU81906%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.es] INFO: Scrape type for MU81906: 2
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_984c7f86a75724dc15d170b7f1b5a4e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_de327eb2b356d499c4800ea5b40ab6bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:38 [auto1.es] INFO: Found listing with ID: MG23268
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG23268%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.es] INFO: Scrape type for MG23268: 1
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e0250>
2025-12-05 17:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_66e0e3b3581f7d1a617bcc654f5c123e.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_66e0e3b3581f7d1a617bcc654f5c123e.jpg saved to cache
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7792d0>
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_57a39538ed2a6269c1b4f852d8691402.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_57a39538ed2a6269c1b4f852d8691402.jpg saved to cache
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a63fd5-b278-54fa-8a1d-26940445b1d5 with identifier: LK91240
2025-12-05 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a63fd5-b278-54fa-8a1d-26940445b1d5 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a63fd5-b278-54fa-8a1d-26940445b1d5 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6a63fd5-b278-54fa-8a1d-26940445b1d5, identifier: LK91240
2025-12-05 17:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6a63fd5-b278-54fa-8a1d-26940445b1d5 with identifier: LK91240
2025-12-05 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6a63fd5-b278-54fa-8a1d-26940445b1d5 with identifier: LK91240
2025-12-05 17:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6a63fd5-b278-54fa-8a1d-26940445b1d5 with identifier: LK91240 to the API
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LK91240>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2025-12-06T16:26:38Z',
 'fuel_type': 'petrol',
 'id': 'd6a63fd5-b278-54fa-8a1d-26940445b1d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK91240',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 60294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Go',
 'transmission': 'manual',
 'trim': 'Go',
 'year': 2019}
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK91240%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.es] INFO: Saving data for LK91240: {'auction_closing_time': 1765038398.0, 'created_time': 1764176711.297369, 'last_price_update_time': 1764954039.787474}
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK91240') HTTP/1.1" 204 0
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_a73f7e24e9c75b66a03ff654a1ab7ab3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:39 [auto1.es] INFO: Found listing with ID: XK16894
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK16894%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.es] INFO: Scrape type for XK16894: 2
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ95413> (referer: https://www.auto1.com/v1/car-details-view/XZ95413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT74540> (referer: https://www.auto1.com/v1/car-details-view/WT74540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU14629> (referer: https://www.auto1.com/v1/car-details-view/ZU14629/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [auto1.es] INFO: Found listing with ID: BX75121
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX75121%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.es] INFO: Scrape type for BX75121: 2
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbd9d10>
2025-12-05 17:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_95f34092d3a7cba952cecab1bf0d429a.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg saved to cache
2025-12-05 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e3610>
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_984c7f86a75724dc15d170b7f1b5a4e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_984c7f86a75724dc15d170b7f1b5a4e0.jpg saved to cache
2025-12-05 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e763d10>
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_de327eb2b356d499c4800ea5b40ab6bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_de327eb2b356d499c4800ea5b40ab6bd.jpg saved to cache
2025-12-05 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_b895b6d5fc52ddfaa908476b69717782.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:40 [auto1.es] INFO: Found listing with ID: PS48880
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS48880%27 HTTP/1.1" 200 None
2025-12-05 17:00:40 [auto1.es] INFO: Scrape type for PS48880: 2
2025-12-05 17:00:40 [auto1.es] INFO: Found listing with ID: TF00078
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF00078%27 HTTP/1.1" 200 None
2025-12-05 17:00:40 [auto1.es] INFO: Scrape type for TF00078: 2
2025-12-05 17:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA58728> (referer: https://www.auto1.com/v1/car-details-view/CA58728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc2c310>
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_a73f7e24e9c75b66a03ff654a1ab7ab3.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_a73f7e24e9c75b66a03ff654a1ab7ab3.jpg saved to cache
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4849b869-0796-5d6f-b9f0-978c74198125 with identifier: XZ95413
2025-12-05 17:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4849b869-0796-5d6f-b9f0-978c74198125 with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4849b869-0796-5d6f-b9f0-978c74198125 with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4849b869-0796-5d6f-b9f0-978c74198125, identifier: XZ95413
2025-12-05 17:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24847743-9d85-5da9-92e8-2b2b4902e12f with identifier: WT74540
2025-12-05 17:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24847743-9d85-5da9-92e8-2b2b4902e12f with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24847743-9d85-5da9-92e8-2b2b4902e12f with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24847743-9d85-5da9-92e8-2b2b4902e12f, identifier: WT74540
2025-12-05 17:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfbabff4-d06f-5354-b67d-70045904400d with identifier: ZU14629
2025-12-05 17:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfbabff4-d06f-5354-b67d-70045904400d with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfbabff4-d06f-5354-b67d-70045904400d with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfbabff4-d06f-5354-b67d-70045904400d, identifier: ZU14629
2025-12-05 17:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4849b869-0796-5d6f-b9f0-978c74198125 with identifier: XZ95413
2025-12-05 17:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4849b869-0796-5d6f-b9f0-978c74198125 with identifier: XZ95413
2025-12-05 17:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4849b869-0796-5d6f-b9f0-978c74198125 with identifier: XZ95413 to the API
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XZ95413>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:37:24Z',
 'fuel_type': 'petrol',
 'id': '4849b869-0796-5d6f-b9f0-978c74198125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ95413',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 75108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe SL Eficacia 4x2',
 'transmission': 'manual',
 'trim': 'SL Eficacia 4x2',
 'year': 2017}
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ95413%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.es] INFO: Saving data for XZ95413: {'auction_closing_time': 1765039044.0, 'created_time': 1764761917.106895, 'last_price_update_time': 1764954042.000207}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ95413') HTTP/1.1" 204 0
2025-12-05 17:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24847743-9d85-5da9-92e8-2b2b4902e12f with identifier: WT74540
2025-12-05 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24847743-9d85-5da9-92e8-2b2b4902e12f with identifier: WT74540
2025-12-05 17:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24847743-9d85-5da9-92e8-2b2b4902e12f with identifier: WT74540 to the API
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WT74540>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:13:36Z',
 'fuel_type': 'diesel',
 'id': '24847743-9d85-5da9-92e8-2b2b4902e12f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT74540',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 129351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2016}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT74540%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.es] INFO: Saving data for WT74540: {'auction_closing_time': 1765037616.0, 'created_time': 1760115989.231862, 'last_price_update_time': 1764954042.497371}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WT74540') HTTP/1.1" 204 0
2025-12-05 17:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfbabff4-d06f-5354-b67d-70045904400d with identifier: ZU14629
2025-12-05 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfbabff4-d06f-5354-b67d-70045904400d with identifier: ZU14629
2025-12-05 17:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bfbabff4-d06f-5354-b67d-70045904400d with identifier: ZU14629 to the API
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU14629>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:03:23Z',
 'fuel_type': 'diesel',
 'id': 'bfbabff4-d06f-5354-b67d-70045904400d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU14629',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 133413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU14629%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.es] INFO: Saving data for ZU14629: {'auction_closing_time': 1765037003.0, 'created_time': 1764050506.485194, 'last_price_update_time': 1764954042.821926}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZU14629') HTTP/1.1" 204 0
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:42 [auto1.es] INFO: Found listing with ID: UD23511
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD23511%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.es] INFO: Scrape type for UD23511: 2
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH93590> (referer: https://www.auto1.com/v1/car-details-view/BH93590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS43600> (referer: https://www.auto1.com/v1/car-details-view/RS43600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG47067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [auto1.es] INFO: Found listing with ID: CZ20129
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ20129%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.es] INFO: Scrape type for CZ20129: 2
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e563b90>
2025-12-05 17:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbd%252Faabd003d469a66c312c778ba72e856be%252Fpa%252FXR81231_b895b6d5fc52ddfaa908476b69717782.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_b895b6d5fc52ddfaa908476b69717782.jpg saved to cache
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f1acce7-155b-530e-9083-7b4727e6dee9
2025-12-05 17:00:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f1acce7-155b-530e-9083-7b4727e6dee9, skipping ID generation
2025-12-05 17:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1acce7-155b-530e-9083-7b4727e6dee9 with scrape type 1
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f1acce7-155b-530e-9083-7b4727e6dee9 from tracking dictionaries
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f1acce7-155b-530e-9083-7b4727e6dee9 sending to next pipeline
2025-12-05 17:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f1acce7-155b-530e-9083-7b4727e6dee9, identifier: XR81231
2025-12-05 17:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0333874a-47ab-5dce-9af8-bb817912f713 with identifier: CA58728
2025-12-05 17:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0333874a-47ab-5dce-9af8-bb817912f713 with scrape type 2
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0333874a-47ab-5dce-9af8-bb817912f713 with scrape type 2
2025-12-05 17:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0333874a-47ab-5dce-9af8-bb817912f713, identifier: CA58728
2025-12-05 17:00:43 [auto1.es] INFO: Found listing with ID: GB22323
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB22323%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [auto1.es] INFO: Scrape type for GB22323: 2
2025-12-05 17:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f1acce7-155b-530e-9083-7b4727e6dee9 with identifier: XR81231
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f1acce7-155b-530e-9083-7b4727e6dee9 with identifier: XR81231
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1f1acce7-155b-530e-9083-7b4727e6dee9 spider: auto1.es
2025-12-05 17:00:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1f1acce7-155b-530e-9083-7b4727e6dee9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:03:52Z',
 'fuel_type': 'diesel',
 'id': '1f1acce7-155b-530e-9083-7b4727e6dee9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR81231',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 88178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2d7d349b13b229133106b858279f2308.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_2c3f3a8fe2e68536dccc9bc8272adb17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_984c7f86a75724dc15d170b7f1b5a4e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_b895b6d5fc52ddfaa908476b69717782.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_3abb329c7bdd6af696dd4018e9aa671a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_ae627a9b873b7ac61bb4d8fd2b6015ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_83ecd43a74d119e371c3e4f7f69abe48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_67554f889aec302af32b2c7e0b842110.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_d0bd2006c20cb76155313d3949ac4f21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_f22b5e3c41e37f02ab73408e58141a1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_79b425511c53cfe8a5cc73ceaaaae121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_66e0e3b3581f7d1a617bcc654f5c123e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_9eceb822fe741fa05a624719d1fbed61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_57a39538ed2a6269c1b4f852d8691402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_de327eb2b356d499c4800ea5b40ab6bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f1acce7-155b-530e-9083-7b4727e6dee9/1f1acce7-155b-530e-9083-7b4727e6dee9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bd/aabd003d469a66c312c778ba72e856be/pa/XR81231_a73f7e24e9c75b66a03ff654a1ab7ab3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2023}
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR81231%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [auto1.es] INFO: Saving data for XR81231: {'created_time': 1764954043.628675, 'last_price_update_time': 1764954043.628685, 'auction_closing_time': 1765037032.0}
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR81231') HTTP/1.1" 204 0
2025-12-05 17:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0333874a-47ab-5dce-9af8-bb817912f713 with identifier: CA58728
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0333874a-47ab-5dce-9af8-bb817912f713 with identifier: CA58728
2025-12-05 17:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0333874a-47ab-5dce-9af8-bb817912f713 with identifier: CA58728 to the API
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA58728>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:44:12Z',
 'fuel_type': 'diesel',
 'id': '0333874a-47ab-5dce-9af8-bb817912f713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA58728',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 57372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA58728%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [auto1.es] INFO: Saving data for CA58728: {'auction_closing_time': 1765039452.0, 'created_time': 1764850043.569739, 'last_price_update_time': 1764954043.99155}
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CA58728') HTTP/1.1" 204 0
2025-12-05 17:00:44 [auto1.es] INFO: Found listing with ID: BH83553
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH83553%27 HTTP/1.1" 200 None
2025-12-05 17:00:44 [auto1.es] INFO: Scrape type for BH83553: 2
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA34757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR76525> (referer: https://www.auto1.com/v1/car-details-view/FR76525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU85997> (referer: https://www.auto1.com/v1/car-details-view/ZU85997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac1210>
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg saved to cache
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb39d0>
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg saved to cache
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b350d9b-22fa-50c8-a7e2-e43bca3758df with identifier: BH93590
2025-12-05 17:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b350d9b-22fa-50c8-a7e2-e43bca3758df with scrape type 2
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b350d9b-22fa-50c8-a7e2-e43bca3758df with scrape type 2
2025-12-05 17:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b350d9b-22fa-50c8-a7e2-e43bca3758df, identifier: BH93590
2025-12-05 17:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc70fe9-40d4-5312-bc75-c49867d2f890 with identifier: RS43600
2025-12-05 17:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc70fe9-40d4-5312-bc75-c49867d2f890 with scrape type 2
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc70fe9-40d4-5312-bc75-c49867d2f890 with scrape type 2
2025-12-05 17:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3bc70fe9-40d4-5312-bc75-c49867d2f890, identifier: RS43600
2025-12-05 17:00:44 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:44 [auto1.es] INFO: Found listing with ID: WF50718
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF50718%27 HTTP/1.1" 200 None
2025-12-05 17:00:44 [auto1.es] INFO: Scrape type for WF50718: 2
2025-12-05 17:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b350d9b-22fa-50c8-a7e2-e43bca3758df with identifier: BH93590
2025-12-05 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b350d9b-22fa-50c8-a7e2-e43bca3758df with identifier: BH93590
2025-12-05 17:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b350d9b-22fa-50c8-a7e2-e43bca3758df with identifier: BH93590 to the API
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH93590>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:56:26Z',
 'fuel_type': 'petrol',
 'id': '6b350d9b-22fa-50c8-a7e2-e43bca3758df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH93590',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 25668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.0 T-GDI Klass LR',
 'transmission': 'manual',
 'trim': 'Klass LR',
 'year': 2021}
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH93590%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [auto1.es] INFO: Saving data for BH93590: {'auction_closing_time': 1765040186.0, 'created_time': 1764762432.622626, 'last_price_update_time': 1764954045.106665}
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BH93590') HTTP/1.1" 204 0
2025-12-05 17:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3bc70fe9-40d4-5312-bc75-c49867d2f890 with identifier: RS43600
2025-12-05 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3bc70fe9-40d4-5312-bc75-c49867d2f890 with identifier: RS43600
2025-12-05 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162030 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162030
2025-12-05 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3bc70fe9-40d4-5312-bc75-c49867d2f890 spider: auto1.es
2025-12-05 17:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3bc70fe9-40d4-5312-bc75-c49867d2f890 due to rule: high_mileage_for_country.json, error: 162030 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162030
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:45:23Z',
 'fuel_type': 'petrol',
 'id': '3bc70fe9-40d4-5312-bc75-c49867d2f890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS43600',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 162030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Color Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Color Edition Start/Stop',
 'year': 2017}
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS43600%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [auto1.es] INFO: Saving data for RS43600: {'auction_closing_time': 1765039523.0, 'created_time': 1763984923.364959, 'last_price_update_time': 1764954045.341522}
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RS43600') HTTP/1.1" 204 0
2025-12-05 17:00:45 [auto1.es] INFO: Found listing with ID: FB95467
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB95467%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [auto1.es] INFO: Scrape type for FB95467: 2
2025-12-05 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:45 [auto1.es] INFO: Found listing with ID: WM08523
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM08523%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [auto1.es] INFO: Scrape type for WM08523: 2
2025-12-05 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ95969> (referer: https://www.auto1.com/v1/car-details-view/YJ95969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516e9e5d-e02d-5882-aa63-2feaf0bb512a with identifier: FR76525
2025-12-05 17:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516e9e5d-e02d-5882-aa63-2feaf0bb512a with scrape type 2
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516e9e5d-e02d-5882-aa63-2feaf0bb512a with scrape type 2
2025-12-05 17:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 516e9e5d-e02d-5882-aa63-2feaf0bb512a, identifier: FR76525
2025-12-05 17:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6276669-9e81-50e3-a5a1-101256cb830c with identifier: ZU85997
2025-12-05 17:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6276669-9e81-50e3-a5a1-101256cb830c with scrape type 2
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6276669-9e81-50e3-a5a1-101256cb830c with scrape type 2
2025-12-05 17:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6276669-9e81-50e3-a5a1-101256cb830c, identifier: ZU85997
2025-12-05 17:00:45 [auto1.es] INFO: Found listing with ID: BD37390
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD37390%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [auto1.es] INFO: Scrape type for BD37390: 0
2025-12-05 17:00:45 [auto1.es] INFO: Found listing with ID: CL61096
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL61096%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [auto1.es] INFO: Scrape type for CL61096: 1
2025-12-05 17:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 516e9e5d-e02d-5882-aa63-2feaf0bb512a with identifier: FR76525
2025-12-05 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 516e9e5d-e02d-5882-aa63-2feaf0bb512a with identifier: FR76525
2025-12-05 17:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 516e9e5d-e02d-5882-aa63-2feaf0bb512a with identifier: FR76525 to the API
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FR76525>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:00:34Z',
 'fuel_type': 'petrol',
 'id': '516e9e5d-e02d-5882-aa63-2feaf0bb512a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR76525',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 144486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR76525%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Saving data for FR76525: {'auction_closing_time': 1765036834.0, 'created_time': 1764413077.232642, 'last_price_update_time': 1764954046.012714}
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FR76525') HTTP/1.1" 204 0
2025-12-05 17:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6276669-9e81-50e3-a5a1-101256cb830c with identifier: ZU85997
2025-12-05 17:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6276669-9e81-50e3-a5a1-101256cb830c with identifier: ZU85997
2025-12-05 17:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 2.2 td premium 4x4', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'manual', 'odometer': 162539, 'odometer_reading_unit': 'km', 'registration_date': '2016-09-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu85997', 'expiration_date': '2025-12-06t16:21:32z', 'origin_country_code': 'es', 'trim': 'premium 4x4', 'year': 2016, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 178, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '2.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': 'e6276669-9e81-50e3-a5a1-101256cb830c', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 162539}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 152,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.2l',
     'engine_horse_power': 178,
     'expiration_date': '2025-12-06t16:21:32z',
     'fuel_type': 'diesel',
     'id': 'e6276669-9e81-50e3-a5a1-101256cb830c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu85997',
     'listing': 'auction',
     'location': 'es, calaf - barcelona',
     'make': 'ssangyong',
     'make_model': 'ssangyong korando',
     'model': 'korando',
     'odometer': 162539,
     'odometer_in_km': 162539,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2016-09-19',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong korando 2.2 td premium 4x4',
     'transmission': 'manual',
     'trim': 'premium 4x4',
     'year': 2016}
2025-12-05 17:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: e6276669-9e81-50e3-a5a1-101256cb830c spider: auto1.es
2025-12-05 17:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e6276669-9e81-50e3-a5a1-101256cb830c due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 2.2 td premium 4x4', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'manual', 'odometer': 162539, 'odometer_reading_unit': 'km', 'registration_date': '2016-09-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu85997', 'expiration_date': '2025-12-06t16:21:32z', 'origin_country_code': 'es', 'trim': 'premium 4x4', 'year': 2016, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 178, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '2.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': 'e6276669-9e81-50e3-a5a1-101256cb830c', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 162539}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 152,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.2l',
     'engine_horse_power': 178,
     'expiration_date': '2025-12-06t16:21:32z',
     'fuel_type': 'diesel',
     'id': 'e6276669-9e81-50e3-a5a1-101256cb830c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu85997',
     'listing': 'auction',
     'location': 'es, calaf - barcelona',
     'make': 'ssangyong',
     'make_model': 'ssangyong korando',
     'model': 'korando',
     'odometer': 162539,
     'odometer_in_km': 162539,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2016-09-19',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong korando 2.2 td premium 4x4',
     'transmission': 'manual',
     'trim': 'premium 4x4',
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 178,
 'expiration_date': '2025-12-06T16:21:32Z',
 'fuel_type': 'diesel',
 'id': 'e6276669-9e81-50e3-a5a1-101256cb830c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU85997',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 162539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Korando 2.2 TD Premium 4x4',
 'transmission': 'manual',
 'trim': 'Premium 4x4',
 'year': 2016}
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU85997%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Saving data for ZU85997: {'auction_closing_time': 1765038092.0, 'created_time': 1764326102.37282, 'last_price_update_time': 1764954046.235367}
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZU85997') HTTP/1.1" 204 0
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: YK00053
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK00053%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for YK00053: 1
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: YS66643
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS66643%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for YS66643: 0
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: KD95012
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD95012%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for KD95012: 2
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK16894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU81906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: TT20052
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT20052%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for TT20052: 0
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: MA07522
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA07522%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for MA07522: 0
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: NE30408
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE30408%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for NE30408: 2
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: JG21123
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG21123%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for JG21123: 0
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: ZN45949
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN45949%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for ZN45949: 2
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48f890>
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_9dccacd072a539f61b5d84a52faecf75.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg saved to cache
2025-12-05 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7957bd5b-35fd-5f6b-adb9-be9cac37b98d with identifier: YJ95969
2025-12-05 17:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7957bd5b-35fd-5f6b-adb9-be9cac37b98d with scrape type 2
2025-12-05 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7957bd5b-35fd-5f6b-adb9-be9cac37b98d with scrape type 2
2025-12-05 17:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7957bd5b-35fd-5f6b-adb9-be9cac37b98d, identifier: YJ95969
2025-12-05 17:00:46 [auto1.es] INFO: Found listing with ID: XK85076
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK85076%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.es] INFO: Scrape type for XK85076: 2
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD77898> (referer: https://www.auto1.com/v1/car-details-view/JD77898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7957bd5b-35fd-5f6b-adb9-be9cac37b98d with identifier: YJ95969
2025-12-05 17:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7957bd5b-35fd-5f6b-adb9-be9cac37b98d with identifier: YJ95969
2025-12-05 17:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7957bd5b-35fd-5f6b-adb9-be9cac37b98d with identifier: YJ95969 to the API
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ95969>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:17:47Z',
 'fuel_type': 'diesel',
 'id': '7957bd5b-35fd-5f6b-adb9-be9cac37b98d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ95969',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 91388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2018}
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ95969%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Saving data for YJ95969: {'auction_closing_time': 1765037867.0, 'created_time': 1764326133.190741, 'last_price_update_time': 1764954047.154613}
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ95969') HTTP/1.1" 204 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: ZC18028
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC18028%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for ZC18028: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: DL72740
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL72740%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for DL72740: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: EM00245
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM00245%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for EM00245: 2
2025-12-05 17:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: JB33502
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB33502%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for JB33502: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: XD59277
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD59277%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for XD59277: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: CN49784
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN49784%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for CN49784: 2
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: UN94841
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN94841%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for UN94841: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: HJ79166
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ79166%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for HJ79166: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: DU89529
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU89529%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for DU89529: 2
2025-12-05 17:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS48880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF00078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX75121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: YZ93012
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ93012%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for YZ93012: 2
2025-12-05 17:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98159d36-1582-5d9d-a7f9-6837b3ab4a71 with identifier: JD77898
2025-12-05 17:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98159d36-1582-5d9d-a7f9-6837b3ab4a71 with scrape type 2
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98159d36-1582-5d9d-a7f9-6837b3ab4a71 with scrape type 2
2025-12-05 17:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98159d36-1582-5d9d-a7f9-6837b3ab4a71, identifier: JD77898
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: BZ91791
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ91791%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for BZ91791: 2
2025-12-05 17:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98159d36-1582-5d9d-a7f9-6837b3ab4a71 with identifier: JD77898
2025-12-05 17:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98159d36-1582-5d9d-a7f9-6837b3ab4a71 with identifier: JD77898
2025-12-05 17:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98159d36-1582-5d9d-a7f9-6837b3ab4a71 with identifier: JD77898 to the API
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JD77898>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:19:35Z',
 'fuel_type': 'diesel',
 'id': '98159d36-1582-5d9d-a7f9-6837b3ab4a71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD77898',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 110884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD77898%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Saving data for JD77898: {'auction_closing_time': 1765037975.0, 'created_time': 1764849591.80146, 'last_price_update_time': 1764954047.847494}
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JD77898') HTTP/1.1" 204 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: RN59031
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59031%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for RN59031: 2
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: ZC35475
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC35475%27 HTTP/1.1" 200 None
2025-12-05 17:00:47 [auto1.es] INFO: Scrape type for ZC35475: 0
2025-12-05 17:00:47 [auto1.es] INFO: Found listing with ID: DY05546
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY05546%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for DY05546: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: TS24968
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS24968%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for TS24968: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: WL06020
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL06020%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for WL06020: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: NK89272
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK89272%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for NK89272: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: EB68225
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB68225%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for EB68225: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: ZV84372
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV84372%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for ZV84372: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: RV17092
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV17092%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for RV17092: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: DU05151
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU05151%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for DU05151: 2
2025-12-05 17:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG23268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ10162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: WP00100
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP00100%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for WP00100: 1
2025-12-05 17:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: TD35080
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD35080%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for TD35080: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: HY80018
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY80018%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for HY80018: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: LZ02035
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ02035%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for LZ02035: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: DN26365
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN26365%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for DN26365: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: XV69403
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV69403%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for XV69403: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: AS29583
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS29583%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for AS29583: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: NW93874
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW93874%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for NW93874: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: PK29781
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK29781%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for PK29781: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: PT42449
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT42449%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for PT42449: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: PU43492
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU43492%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for PU43492: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: AT47052
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT47052%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for AT47052: 1
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: MZ33552
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ33552%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for MZ33552: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: DA95457
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA95457%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for DA95457: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: PZ15867
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ15867%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for PZ15867: 1
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: JN15860
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN15860%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for JN15860: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: AW95663
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW95663%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for AW95663: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: WF84546
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF84546%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for WF84546: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: XA83744
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA83744%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for XA83744: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: JF98735
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF98735%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for JF98735: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: NT91356
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT91356%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for NT91356: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: RX12180
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX12180%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for RX12180: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: WL79850
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL79850%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for WL79850: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: HZ02558
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ02558%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for HZ02558: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: XV93308
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV93308%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for XV93308: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: EP28606
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP28606%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for EP28606: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: VP76841
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP76841%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for VP76841: 0
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: MB38026
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB38026%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for MB38026: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: FX24993
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX24993%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for FX24993: 2
2025-12-05 17:00:48 [auto1.es] INFO: Found listing with ID: FS52341
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS52341%27 HTTP/1.1" 200 None
2025-12-05 17:00:48 [auto1.es] INFO: Scrape type for FS52341: 0
2025-12-05 17:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD23511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ20129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS89996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP33027> (referer: https://www.auto1.com/v1/car-details-view/GP33027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013d0b2c-52d0-575e-bc2e-5609fdeb9307 with identifier: GP33027
2025-12-05 17:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013d0b2c-52d0-575e-bc2e-5609fdeb9307 with scrape type 2
2025-12-05 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013d0b2c-52d0-575e-bc2e-5609fdeb9307 with scrape type 2
2025-12-05 17:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 013d0b2c-52d0-575e-bc2e-5609fdeb9307, identifier: GP33027
2025-12-05 17:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 013d0b2c-52d0-575e-bc2e-5609fdeb9307 with identifier: GP33027
2025-12-05 17:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 013d0b2c-52d0-575e-bc2e-5609fdeb9307 with identifier: GP33027
2025-12-05 17:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 013d0b2c-52d0-575e-bc2e-5609fdeb9307 with identifier: GP33027 to the API
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP33027>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:59:48Z',
 'fuel_type': 'petrol',
 'id': '013d0b2c-52d0-575e-bc2e-5609fdeb9307',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP33027',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 68320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP33027%27 HTTP/1.1" 200 None
2025-12-05 17:00:49 [auto1.es] INFO: Saving data for GP33027: {'auction_closing_time': 1765040388.0, 'created_time': 1764850351.932372, 'last_price_update_time': 1764954049.727484}
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GP33027') HTTP/1.1" 204 0
2025-12-05 17:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF50718/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB22323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV87659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD95012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK85076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK00053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA34757> (referer: https://www.auto1.com/v1/car-details-view/ZA34757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a264cf2d-3549-5857-9d11-ee5ffbb21893 with identifier: ZA34757
2025-12-05 17:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a264cf2d-3549-5857-9d11-ee5ffbb21893 with scrape type 2
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a264cf2d-3549-5857-9d11-ee5ffbb21893 with scrape type 2
2025-12-05 17:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a264cf2d-3549-5857-9d11-ee5ffbb21893, identifier: ZA34757
2025-12-05 17:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a264cf2d-3549-5857-9d11-ee5ffbb21893 with identifier: ZA34757
2025-12-05 17:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a264cf2d-3549-5857-9d11-ee5ffbb21893 with identifier: ZA34757
2025-12-05 17:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a264cf2d-3549-5857-9d11-ee5ffbb21893 with identifier: ZA34757 to the API
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZA34757>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 121,
 'expiration_date': '2025-12-06T16:19:46Z',
 'fuel_type': 'petrol',
 'id': 'a264cf2d-3549-5857-9d11-ee5ffbb21893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA34757',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 90439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Zenith',
 'transmission': 'manual',
 'trim': 'Zenith',
 'year': 2018}
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA34757%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [auto1.es] INFO: Saving data for ZA34757: {'auction_closing_time': 1765037986.0, 'created_time': 1764850444.205736, 'last_price_update_time': 1764954050.989081}
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA34757') HTTP/1.1" 204 0
2025-12-05 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU81906> (referer: https://www.auto1.com/v1/car-details-view/MU81906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV84372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX24993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN59031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK16894> (referer: https://www.auto1.com/v1/car-details-view/XK16894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8556dc-41d0-51eb-ad1b-49204d376413 with identifier: MU81906
2025-12-05 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8556dc-41d0-51eb-ad1b-49204d376413 with scrape type 2
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae8556dc-41d0-51eb-ad1b-49204d376413 with scrape type 2
2025-12-05 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae8556dc-41d0-51eb-ad1b-49204d376413, identifier: MU81906
2025-12-05 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae8556dc-41d0-51eb-ad1b-49204d376413 with identifier: MU81906
2025-12-05 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae8556dc-41d0-51eb-ad1b-49204d376413 with identifier: MU81906
2025-12-05 17:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ae8556dc-41d0-51eb-ad1b-49204d376413 with identifier: MU81906 to the API
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU81906>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:18:36Z',
 'fuel_type': 'diesel',
 'id': 'ae8556dc-41d0-51eb-ad1b-49204d376413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU81906',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 109222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU81906%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [auto1.es] INFO: Saving data for MU81906: {'auction_closing_time': 1765037916.0, 'created_time': 1764761658.917213, 'last_price_update_time': 1764954051.511146}
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MU81906') HTTP/1.1" 204 0
2025-12-05 17:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e2920c-bfa8-525b-9745-12065827ec51 with identifier: XK16894
2025-12-05 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e2920c-bfa8-525b-9745-12065827ec51 with scrape type 2
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e2920c-bfa8-525b-9745-12065827ec51 with scrape type 2
2025-12-05 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58e2920c-bfa8-525b-9745-12065827ec51, identifier: XK16894
2025-12-05 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58e2920c-bfa8-525b-9745-12065827ec51 with identifier: XK16894
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58e2920c-bfa8-525b-9745-12065827ec51 with identifier: XK16894
2025-12-05 17:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58e2920c-bfa8-525b-9745-12065827ec51 with identifier: XK16894 to the API
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK16894>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:06:20Z',
 'fuel_type': 'petrol',
 'id': '58e2920c-bfa8-525b-9745-12065827ec51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK16894',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 31494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK16894%27 HTTP/1.1" 200 None
2025-12-05 17:00:52 [auto1.es] INFO: Saving data for XK16894: {'auction_closing_time': 1765037180.0, 'created_time': 1764762078.700334, 'last_price_update_time': 1764954052.04258}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XK16894') HTTP/1.1" 204 0
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD23511> (referer: https://www.auto1.com/v1/car-details-view/UD23511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB38026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c8d823-6f53-5378-8084-33ad7e08267b with identifier: UD23511
2025-12-05 17:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c8d823-6f53-5378-8084-33ad7e08267b with scrape type 2
2025-12-05 17:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9c8d823-6f53-5378-8084-33ad7e08267b with scrape type 2
2025-12-05 17:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9c8d823-6f53-5378-8084-33ad7e08267b, identifier: UD23511
2025-12-05 17:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9c8d823-6f53-5378-8084-33ad7e08267b with identifier: UD23511
2025-12-05 17:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9c8d823-6f53-5378-8084-33ad7e08267b with identifier: UD23511
2025-12-05 17:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9c8d823-6f53-5378-8084-33ad7e08267b with identifier: UD23511 to the API
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD23511>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:07:24Z',
 'fuel_type': 'petrol',
 'id': 'd9c8d823-6f53-5378-8084-33ad7e08267b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD23511',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 81764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD23511%27 HTTP/1.1" 200 None
2025-12-05 17:00:52 [auto1.es] INFO: Saving data for UD23511: {'auction_closing_time': 1765037244.0, 'created_time': 1761152770.338445, 'last_price_update_time': 1764954052.572213}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD23511') HTTP/1.1" 204 0
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX12180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT91356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS89996> (referer: https://www.auto1.com/v1/car-details-view/SS89996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ20129> (referer: https://www.auto1.com/v1/car-details-view/CZ20129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f30250e-0cf7-5860-b850-83cb7b44c984 with identifier: SS89996
2025-12-05 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f30250e-0cf7-5860-b850-83cb7b44c984 with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f30250e-0cf7-5860-b850-83cb7b44c984 with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f30250e-0cf7-5860-b850-83cb7b44c984, identifier: SS89996
2025-12-05 17:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f30250e-0cf7-5860-b850-83cb7b44c984 with identifier: SS89996
2025-12-05 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f30250e-0cf7-5860-b850-83cb7b44c984 with identifier: SS89996
2025-12-05 17:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f30250e-0cf7-5860-b850-83cb7b44c984 with identifier: SS89996 to the API
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SS89996>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2025-12-06T16:16:35Z',
 'fuel_type': 'petrol',
 'id': '1f30250e-0cf7-5860-b850-83cb7b44c984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS89996',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 83063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS89996%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [auto1.es] INFO: Saving data for SS89996: {'auction_closing_time': 1765037795.0, 'created_time': 1764761924.31775, 'last_price_update_time': 1764954053.432525}
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SS89996') HTTP/1.1" 204 0
2025-12-05 17:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP28606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF98735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096e1f81-862c-5625-840d-a39ef2177b43 with identifier: CZ20129
2025-12-05 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096e1f81-862c-5625-840d-a39ef2177b43 with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 096e1f81-862c-5625-840d-a39ef2177b43 with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 096e1f81-862c-5625-840d-a39ef2177b43, identifier: CZ20129
2025-12-05 17:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 096e1f81-862c-5625-840d-a39ef2177b43 with identifier: CZ20129
2025-12-05 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 096e1f81-862c-5625-840d-a39ef2177b43 with identifier: CZ20129
2025-12-05 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160916 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160916
2025-12-05 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 096e1f81-862c-5625-840d-a39ef2177b43 spider: auto1.es
2025-12-05 17:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 096e1f81-862c-5625-840d-a39ef2177b43 due to rule: high_mileage_for_country.json, error: 160916 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160916
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:03:58Z',
 'fuel_type': 'petrol',
 'id': '096e1f81-862c-5625-840d-a39ef2177b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ20129',
 'listing': 'auction',
 'location': 'Palma de Mallorca',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 160916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR Go 2',
 'transmission': 'manual',
 'trim': 'FR Go 2',
 'year': 2021}
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ20129%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [auto1.es] INFO: Saving data for CZ20129: {'auction_closing_time': 1765037038.0, 'created_time': 1764762787.120681, 'last_price_update_time': 1764954053.764794}
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ20129') HTTP/1.1" 204 0
2025-12-05 17:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK85076> (referer: https://www.auto1.com/v1/car-details-view/XK85076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD95012> (referer: https://www.auto1.com/v1/car-details-view/KD95012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK00053> (referer: https://www.auto1.com/v1/car-details-view/YK00053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64ef479-e07f-58b0-a91e-26c8554fd781 with identifier: XK85076
2025-12-05 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64ef479-e07f-58b0-a91e-26c8554fd781 with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64ef479-e07f-58b0-a91e-26c8554fd781 with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f64ef479-e07f-58b0-a91e-26c8554fd781, identifier: XK85076
2025-12-05 17:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f64ef479-e07f-58b0-a91e-26c8554fd781 with identifier: XK85076
2025-12-05 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f64ef479-e07f-58b0-a91e-26c8554fd781 with identifier: XK85076
2025-12-05 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157205 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157205
2025-12-05 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f64ef479-e07f-58b0-a91e-26c8554fd781 spider: auto1.es
2025-12-05 17:00:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f64ef479-e07f-58b0-a91e-26c8554fd781 due to rule: high_mileage_for_country.json, error: 157205 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157205
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-06T16:25:42Z',
 'fuel_type': 'petrol',
 'id': 'f64ef479-e07f-58b0-a91e-26c8554fd781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK85076',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 157205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK85076%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [auto1.es] INFO: Saving data for XK85076: {'auction_closing_time': 1765038342.0, 'created_time': 1764762015.878924, 'last_price_update_time': 1764954054.19046}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XK85076') HTTP/1.1" 204 0
2025-12-05 17:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a2b72e-bcf4-50ed-b598-c78556ea7425 with identifier: KD95012
2025-12-05 17:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a2b72e-bcf4-50ed-b598-c78556ea7425 with scrape type 2
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97a2b72e-bcf4-50ed-b598-c78556ea7425 with scrape type 2
2025-12-05 17:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97a2b72e-bcf4-50ed-b598-c78556ea7425, identifier: KD95012
2025-12-05 17:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 with identifier: YK00053
2025-12-05 17:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 with scrape type 1
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_b7a8fc96f52ac3aacd58103f08446867.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_b7a8fc96f52ac3aacd58103f08446867.jpg not downloaded yet
2025-12-05 17:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97a2b72e-bcf4-50ed-b598-c78556ea7425 with identifier: KD95012
2025-12-05 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97a2b72e-bcf4-50ed-b598-c78556ea7425 with identifier: KD95012
2025-12-05 17:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97a2b72e-bcf4-50ed-b598-c78556ea7425 with identifier: KD95012 to the API
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KD95012>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:16:24Z',
 'fuel_type': 'diesel',
 'id': '97a2b72e-bcf4-50ed-b598-c78556ea7425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD95012',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 55935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2020}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD95012%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [auto1.es] INFO: Saving data for KD95012: {'auction_closing_time': 1765037784.0, 'created_time': 1764762785.24049, 'last_price_update_time': 1764954054.639654}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD95012') HTTP/1.1" 204 0
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_d03d4cb9b4c731a7188e2ca7f6b9d512.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_d03d4cb9b4c731a7188e2ca7f6b9d512.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg not downloaded yet
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB22323> (referer: https://www.auto1.com/v1/car-details-view/GB22323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV87659> (referer: https://www.auto1.com/v1/car-details-view/RV87659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_00ede023256efa089d92b7e72e0a810f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_00ede023256efa089d92b7e72e0a810f.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_76ebfb5c526e60b48e30d2410790dca2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_76ebfb5c526e60b48e30d2410790dca2.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_322654c0ba029810929e76ed9e3fc87d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_322654c0ba029810929e76ed9e3fc87d.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_4afe182f7f5b2f587cb8be9317faaee4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_4afe182f7f5b2f587cb8be9317faaee4.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_480dbfc20356ba49f1eaecae93b9e7cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_480dbfc20356ba49f1eaecae93b9e7cf.jpg not downloaded yet
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_b7a8fc96f52ac3aacd58103f08446867.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_2c5ddec7f1c6ffd90775a38be190f1c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_2c5ddec7f1c6ffd90775a38be190f1c3.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_359db7a752b4303a6ffc11c6a7d21a65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_359db7a752b4303a6ffc11c6a7d21a65.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_816a37d94d8be527d107a080dd3ef231.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_816a37d94d8be527d107a080dd3ef231.jpg not downloaded yet
2025-12-05 17:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48753f0-3389-568e-835f-7bbb40aafc07 with identifier: GB22323
2025-12-05 17:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48753f0-3389-568e-835f-7bbb40aafc07 with scrape type 2
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48753f0-3389-568e-835f-7bbb40aafc07 with scrape type 2
2025-12-05 17:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f48753f0-3389-568e-835f-7bbb40aafc07, identifier: GB22323
2025-12-05 17:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e903047-7fcc-5d1e-9752-76a2f6a07d8d with identifier: RV87659
2025-12-05 17:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e903047-7fcc-5d1e-9752-76a2f6a07d8d with scrape type 2
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e903047-7fcc-5d1e-9752-76a2f6a07d8d with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e903047-7fcc-5d1e-9752-76a2f6a07d8d, identifier: RV87659
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_13504f6f4060a7cf86d42a0d4a842f6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_13504f6f4060a7cf86d42a0d4a842f6b.jpg not downloaded yet
2025-12-05 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f48753f0-3389-568e-835f-7bbb40aafc07 with identifier: GB22323
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f48753f0-3389-568e-835f-7bbb40aafc07 with identifier: GB22323
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f48753f0-3389-568e-835f-7bbb40aafc07 spider: auto1.es
2025-12-05 17:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f48753f0-3389-568e-835f-7bbb40aafc07 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:49:55Z',
 'fuel_type': 'diesel',
 'id': 'f48753f0-3389-568e-835f-7bbb40aafc07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB22323',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 49222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi Mild-Hybrid 300 L1 Trend',
 'transmission': 'manual',
 'trim': '300 L1 Trend',
 'year': 2023}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB22323%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [auto1.es] INFO: Saving data for GB22323: {'auction_closing_time': 1765039795.0, 'created_time': 1764761925.146604, 'last_price_update_time': 1764954055.246037}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GB22323') HTTP/1.1" 204 0
2025-12-05 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e903047-7fcc-5d1e-9752-76a2f6a07d8d with identifier: RV87659
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e903047-7fcc-5d1e-9752-76a2f6a07d8d with identifier: RV87659
2025-12-05 17:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e903047-7fcc-5d1e-9752-76a2f6a07d8d with identifier: RV87659 to the API
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV87659>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:25:47Z',
 'fuel_type': 'diesel',
 'id': '0e903047-7fcc-5d1e-9752-76a2f6a07d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV87659',
 'listing': 'auction',
 'location': 'ES, Santa Ana',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 102874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2018}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV87659%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [auto1.es] INFO: Saving data for RV87659: {'auction_closing_time': 1765038347.0, 'created_time': 1764849903.365079, 'last_price_update_time': 1764954055.585086}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV87659') HTTP/1.1" 204 0
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_4afe182f7f5b2f587cb8be9317faaee4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_d03d4cb9b4c731a7188e2ca7f6b9d512.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_f9d163e020d3fea74e070652dab85f79.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_f9d163e020d3fea74e070652dab85f79.jpg not downloaded yet
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF50718> (referer: https://www.auto1.com/v1/car-details-view/WF50718/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF84546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX24993> (referer: https://www.auto1.com/v1/car-details-view/FX24993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN59031> (referer: https://www.auto1.com/v1/car-details-view/RN59031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB38026> (referer: https://www.auto1.com/v1/car-details-view/MB38026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7fe10>
2025-12-05 17:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_b7a8fc96f52ac3aacd58103f08446867.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_b7a8fc96f52ac3aacd58103f08446867.jpg saved to cache
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_80609283ebbac9d6aea5cb34498fc2e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_80609283ebbac9d6aea5cb34498fc2e8.jpg not downloaded yet
2025-12-05 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_816a37d94d8be527d107a080dd3ef231.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_bba16cd53ec64655d669be8fc3b5ec84.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_bba16cd53ec64655d669be8fc3b5ec84.jpg not downloaded yet
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dadec50>
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_4afe182f7f5b2f587cb8be9317faaee4.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_4afe182f7f5b2f587cb8be9317faaee4.jpg saved to cache
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db74dd0>
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_d03d4cb9b4c731a7188e2ca7f6b9d512.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_d03d4cb9b4c731a7188e2ca7f6b9d512.jpg saved to cache
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c with identifier: WF50718
2025-12-05 17:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c, identifier: WF50718
2025-12-05 17:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02d4694e-fc01-58ec-a0ac-f43941d09847 with identifier: FX24993
2025-12-05 17:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d4694e-fc01-58ec-a0ac-f43941d09847 with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02d4694e-fc01-58ec-a0ac-f43941d09847 with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 02d4694e-fc01-58ec-a0ac-f43941d09847, identifier: FX24993
2025-12-05 17:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031
2025-12-05 17:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ebfd31-f694-5f53-a31c-b849cd5c631c with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3ebfd31-f694-5f53-a31c-b849cd5c631c with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3ebfd31-f694-5f53-a31c-b849cd5c631c, identifier: RN59031
2025-12-05 17:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a680a1-0180-526e-945b-1c90977c69a9 with identifier: MB38026
2025-12-05 17:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a680a1-0180-526e-945b-1c90977c69a9 with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a680a1-0180-526e-945b-1c90977c69a9 with scrape type 2
2025-12-05 17:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2a680a1-0180-526e-945b-1c90977c69a9, identifier: MB38026
2025-12-05 17:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c with identifier: WF50718
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c with identifier: WF50718
2025-12-05 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
2025-12-05 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c spider: auto1.es
2025-12-05 17:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 62bbbccc-0e59-5aae-a5a4-7a7a32e7464c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:18:57Z',
 'fuel_type': 'diesel',
 'id': '62bbbccc-0e59-5aae-a5a4-7a7a32e7464c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF50718',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 115126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline FWD',
 'transmission': 'automatic',
 'trim': 'Trendline FWD',
 'year': 2021}
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF50718%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [auto1.es] INFO: Saving data for WF50718: {'auction_closing_time': 1765037937.0, 'created_time': 1764761963.87154, 'last_price_update_time': 1764954057.183618}
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WF50718') HTTP/1.1" 204 0
2025-12-05 17:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 02d4694e-fc01-58ec-a0ac-f43941d09847 with identifier: FX24993
2025-12-05 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 02d4694e-fc01-58ec-a0ac-f43941d09847 with identifier: FX24993
2025-12-05 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker express' containing 'dokker'
2025-12-05 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 02d4694e-fc01-58ec-a0ac-f43941d09847 spider: auto1.es
2025-12-05 17:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 02d4694e-fc01-58ec-a0ac-f43941d09847 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker express' containing 'dokker'
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:26:56Z',
 'fuel_type': 'diesel',
 'id': '02d4694e-fc01-58ec-a0ac-f43941d09847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX24993',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Dacia',
 'model': 'Dokker Express',
 'odometer': 146725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Dacia Dokker Express 1.5 Blue dCi Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX24993%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [auto1.es] INFO: Saving data for FX24993: {'auction_closing_time': 1765038416.0, 'created_time': 1764003703.534274, 'last_price_update_time': 1764954057.437846}
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX24993') HTTP/1.1" 204 0
2025-12-05 17:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2025-12-05 17:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031
2025-12-05 17:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031 to the API
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN59031>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:17:09Z',
 'fuel_type': 'diesel',
 'id': 'b3ebfd31-f694-5f53-a31c-b849cd5c631c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN59031',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 121590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59031%27 HTTP/1.1" 200 None
2025-12-05 17:00:58 [auto1.es] INFO: Saving data for RN59031: {'auction_closing_time': 1765037829.0, 'created_time': 1764003666.820244, 'last_price_update_time': 1764954058.027092}
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN59031') HTTP/1.1" 204 0
2025-12-05 17:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2a680a1-0180-526e-945b-1c90977c69a9 with identifier: MB38026
2025-12-05 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2a680a1-0180-526e-945b-1c90977c69a9 with identifier: MB38026
2025-12-05 17:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2a680a1-0180-526e-945b-1c90977c69a9 with identifier: MB38026 to the API
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB38026>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:11:47Z',
 'fuel_type': 'diesel',
 'id': 'd2a680a1-0180-526e-945b-1c90977c69a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB38026',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 60551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Drive 2WD',
 'transmission': 'manual',
 'trim': 'Drive 2WD',
 'year': 2019}
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB38026%27 HTTP/1.1" 200 None
2025-12-05 17:00:58 [auto1.es] INFO: Saving data for MB38026: {'auction_closing_time': 1765037507.0, 'created_time': 1764849548.39533, 'last_price_update_time': 1764954058.346988}
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MB38026') HTTP/1.1" 204 0
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_359db7a752b4303a6ffc11c6a7d21a65.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_9e574386a18b2705c658b47f098c9ec9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_9e574386a18b2705c658b47f098c9ec9.jpg not downloaded yet
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_76ebfb5c526e60b48e30d2410790dca2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_13504f6f4060a7cf86d42a0d4a842f6b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_2c5ddec7f1c6ffd90775a38be190f1c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_322654c0ba029810929e76ed9e3fc87d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_f9d163e020d3fea74e070652dab85f79.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_480dbfc20356ba49f1eaecae93b9e7cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT91356> (referer: https://www.auto1.com/v1/car-details-view/NT91356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV84372> (referer: https://www.auto1.com/v1/car-details-view/ZV84372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN49784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7297d0>
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_816a37d94d8be527d107a080dd3ef231.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_816a37d94d8be527d107a080dd3ef231.jpg saved to cache
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e498e50>
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_359db7a752b4303a6ffc11c6a7d21a65.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_359db7a752b4303a6ffc11c6a7d21a65.jpg saved to cache
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e65b2d0>
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_76ebfb5c526e60b48e30d2410790dca2.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_76ebfb5c526e60b48e30d2410790dca2.jpg saved to cache
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4aee90>
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_13504f6f4060a7cf86d42a0d4a842f6b.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_13504f6f4060a7cf86d42a0d4a842f6b.jpg saved to cache
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e677150>
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_2c5ddec7f1c6ffd90775a38be190f1c3.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_2c5ddec7f1c6ffd90775a38be190f1c3.jpg saved to cache
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e677110>
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_322654c0ba029810929e76ed9e3fc87d.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_322654c0ba029810929e76ed9e3fc87d.jpg saved to cache
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b8c50>
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_f9d163e020d3fea74e070652dab85f79.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_f9d163e020d3fea74e070652dab85f79.jpg saved to cache
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e571410>
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_480dbfc20356ba49f1eaecae93b9e7cf.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_480dbfc20356ba49f1eaecae93b9e7cf.jpg saved to cache
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70838827-c97b-5b75-bb20-1442cf8b5897 with identifier: NT91356
2025-12-05 17:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70838827-c97b-5b75-bb20-1442cf8b5897 with scrape type 2
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70838827-c97b-5b75-bb20-1442cf8b5897 with scrape type 2
2025-12-05 17:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 70838827-c97b-5b75-bb20-1442cf8b5897, identifier: NT91356
2025-12-05 17:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf9d399-5f77-5a78-80ef-a9361698918c with identifier: ZV84372
2025-12-05 17:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf9d399-5f77-5a78-80ef-a9361698918c with scrape type 2
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf9d399-5f77-5a78-80ef-a9361698918c with scrape type 2
2025-12-05 17:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cbf9d399-5f77-5a78-80ef-a9361698918c, identifier: ZV84372
2025-12-05 17:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 70838827-c97b-5b75-bb20-1442cf8b5897 with identifier: NT91356
2025-12-05 17:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 70838827-c97b-5b75-bb20-1442cf8b5897 with identifier: NT91356
2025-12-05 17:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 140420 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    140420
2025-12-05 17:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 70838827-c97b-5b75-bb20-1442cf8b5897 spider: auto1.es
2025-12-05 17:01:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 70838827-c97b-5b75-bb20-1442cf8b5897 due to rule: high_mileage_for_make.json, error: 140420 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    140420
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:46:12Z',
 'fuel_type': 'petrol',
 'id': '70838827-c97b-5b75-bb20-1442cf8b5897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT91356',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Fiat',
 'model': '500',
 'odometer': 140420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT91356%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [auto1.es] INFO: Saving data for NT91356: {'auction_closing_time': 1765039572.0, 'created_time': 1761649986.708692, 'last_price_update_time': 1764954061.133462}
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NT91356') HTTP/1.1" 204 0
2025-12-05 17:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cbf9d399-5f77-5a78-80ef-a9361698918c with identifier: ZV84372
2025-12-05 17:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cbf9d399-5f77-5a78-80ef-a9361698918c with identifier: ZV84372
2025-12-05 17:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cbf9d399-5f77-5a78-80ef-a9361698918c with identifier: ZV84372 to the API
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV84372>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:01:23Z',
 'fuel_type': 'diesel',
 'id': 'cbf9d399-5f77-5a78-80ef-a9361698918c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV84372',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 118455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV84372%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [auto1.es] INFO: Saving data for ZV84372: {'auction_closing_time': 1765036883.0, 'created_time': 1761127287.532913, 'last_price_update_time': 1764954061.445497}
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV84372') HTTP/1.1" 204 0
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_bba16cd53ec64655d669be8fc3b5ec84.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_80609283ebbac9d6aea5cb34498fc2e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_00ede023256efa089d92b7e72e0a810f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_9e574386a18b2705c658b47f098c9ec9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ33552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF98735> (referer: https://www.auto1.com/v1/car-details-view/JF98735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ10162> (referer: https://www.auto1.com/v1/car-details-view/MJ10162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX12180> (referer: https://www.auto1.com/v1/car-details-view/RX12180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e500110>
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_bba16cd53ec64655d669be8fc3b5ec84.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_bba16cd53ec64655d669be8fc3b5ec84.jpg saved to cache
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5889d0>
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_80609283ebbac9d6aea5cb34498fc2e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_80609283ebbac9d6aea5cb34498fc2e8.jpg saved to cache
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ15867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54bbd0>
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_00ede023256efa089d92b7e72e0a810f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_00ede023256efa089d92b7e72e0a810f.jpg saved to cache
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba1f90>
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_9e574386a18b2705c658b47f098c9ec9.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_9e574386a18b2705c658b47f098c9ec9.jpg saved to cache
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e92a1d0>
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F73%252F6d73d7f64d70e8c97cd050a0902b52ac%252Fpa%252FYK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg saved to cache
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9
2025-12-05 17:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9, skipping ID generation
2025-12-05 17:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 with scrape type 1
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 from tracking dictionaries
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 sending to next pipeline
2025-12-05 17:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9, identifier: YK00053
2025-12-05 17:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b20ecc-63a0-5b09-a793-9e1411dc1460 with identifier: JF98735
2025-12-05 17:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b20ecc-63a0-5b09-a793-9e1411dc1460 with scrape type 2
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b20ecc-63a0-5b09-a793-9e1411dc1460 with scrape type 2
2025-12-05 17:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26b20ecc-63a0-5b09-a793-9e1411dc1460, identifier: JF98735
2025-12-05 17:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52df0e09-0e7a-5e69-bc4b-0203998b866a with identifier: MJ10162
2025-12-05 17:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52df0e09-0e7a-5e69-bc4b-0203998b866a with scrape type 2
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52df0e09-0e7a-5e69-bc4b-0203998b866a with scrape type 2
2025-12-05 17:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52df0e09-0e7a-5e69-bc4b-0203998b866a, identifier: MJ10162
2025-12-05 17:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180
2025-12-05 17:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f471d87e-8ce6-5aba-a67b-66d0efd62d3d with scrape type 2
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f471d87e-8ce6-5aba-a67b-66d0efd62d3d with scrape type 2
2025-12-05 17:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f471d87e-8ce6-5aba-a67b-66d0efd62d3d, identifier: RX12180
2025-12-05 17:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 with identifier: YK00053
2025-12-05 17:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 with identifier: YK00053
2025-12-05 17:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9 with identifier: YK00053 to the API
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:02:11Z',
 'fuel_type': 'petrol',
 'id': 'ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK00053',
 'listing': 'auction',
 'location': 'ES, Figueres',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 140525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_b7a8fc96f52ac3aacd58103f08446867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_d03d4cb9b4c731a7188e2ca7f6b9d512.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_ff5e0d1b5af9eaa0ebdaf0fee374bc1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_00ede023256efa089d92b7e72e0a810f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_76ebfb5c526e60b48e30d2410790dca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_322654c0ba029810929e76ed9e3fc87d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_4afe182f7f5b2f587cb8be9317faaee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_480dbfc20356ba49f1eaecae93b9e7cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_2c5ddec7f1c6ffd90775a38be190f1c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_359db7a752b4303a6ffc11c6a7d21a65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_816a37d94d8be527d107a080dd3ef231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_13504f6f4060a7cf86d42a0d4a842f6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_f9d163e020d3fea74e070652dab85f79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_80609283ebbac9d6aea5cb34498fc2e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_bba16cd53ec64655d669be8fc3b5ec84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9/ac0eb4e9-0b2d-58d0-b5fa-762574ff38e9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/73/6d73d7f64d70e8c97cd050a0902b52ac/pa/YK00053_9e574386a18b2705c658b47f098c9ec9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 T2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2019}
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK00053%27 HTTP/1.1" 200 None
2025-12-05 17:01:03 [auto1.es] INFO: Saving data for YK00053: {'created_time': 1764954063.829094, 'last_price_update_time': 1764954063.829104, 'auction_closing_time': 1765036931.0}
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK00053') HTTP/1.1" 204 0
2025-12-05 17:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26b20ecc-63a0-5b09-a793-9e1411dc1460 with identifier: JF98735
2025-12-05 17:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26b20ecc-63a0-5b09-a793-9e1411dc1460 with identifier: JF98735
2025-12-05 17:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26b20ecc-63a0-5b09-a793-9e1411dc1460 with identifier: JF98735 to the API
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF98735>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2025-12-06T16:06:23Z',
 'fuel_type': 'petrol',
 'id': '26b20ecc-63a0-5b09-a793-9e1411dc1460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF98735',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 53358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF98735%27 HTTP/1.1" 200 None
2025-12-05 17:01:04 [auto1.es] INFO: Saving data for JF98735: {'auction_closing_time': 1765037183.0, 'created_time': 1764850366.37912, 'last_price_update_time': 1764954064.142841}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JF98735') HTTP/1.1" 204 0
2025-12-05 17:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52df0e09-0e7a-5e69-bc4b-0203998b866a with identifier: MJ10162
2025-12-05 17:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52df0e09-0e7a-5e69-bc4b-0203998b866a with identifier: MJ10162
2025-12-05 17:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52df0e09-0e7a-5e69-bc4b-0203998b866a with identifier: MJ10162 to the API
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ10162>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:27:37Z',
 'fuel_type': 'diesel',
 'id': '52df0e09-0e7a-5e69-bc4b-0203998b866a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ10162',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'BMW',
 'model': '5er',
 'odometer': 128477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2018}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ10162%27 HTTP/1.1" 200 None
2025-12-05 17:01:04 [auto1.es] INFO: Saving data for MJ10162: {'auction_closing_time': 1765038457.0, 'created_time': 1764762012.703584, 'last_price_update_time': 1764954064.50067}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ10162') HTTP/1.1" 204 0
2025-12-05 17:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180
2025-12-05 17:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180
2025-12-05 17:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f471d87e-8ce6-5aba-a67b-66d0efd62d3d with identifier: RX12180 to the API
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX12180>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:29:19Z',
 'fuel_type': 'gas',
 'id': 'f471d87e-8ce6-5aba-a67b-66d0efd62d3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX12180',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 89066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 LPG Design LINE',
 'transmission': 'manual',
 'trim': 'Design LINE',
 'year': 2019}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX12180%27 HTTP/1.1" 200 None
2025-12-05 17:01:04 [auto1.es] INFO: Saving data for RX12180: {'auction_closing_time': 1765038559.0, 'created_time': 1764849753.855496, 'last_price_update_time': 1764954064.800297}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX12180') HTTP/1.1" 204 0
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT47052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT42449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK29781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP28606> (referer: https://www.auto1.com/v1/car-details-view/EP28606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF84546> (referer: https://www.auto1.com/v1/car-details-view/WF84546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN49784> (referer: https://www.auto1.com/v1/car-details-view/CN49784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU43492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd71253-9251-527f-b725-d852a031e157 with identifier: EP28606
2025-12-05 17:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd71253-9251-527f-b725-d852a031e157 with scrape type 2
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcd71253-9251-527f-b725-d852a031e157 with scrape type 2
2025-12-05 17:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fcd71253-9251-527f-b725-d852a031e157, identifier: EP28606
2025-12-05 17:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fcd71253-9251-527f-b725-d852a031e157 with identifier: EP28606
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2025-12-05 17:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fcd71253-9251-527f-b725-d852a031e157 with identifier: EP28606
2025-12-05 17:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fcd71253-9251-527f-b725-d852a031e157 with identifier: EP28606 to the API
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP28606>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 400,
 'expiration_date': '2025-12-06T16:07:42Z',
 'fuel_type': 'electro',
 'id': 'fcd71253-9251-527f-b725-d852a031e157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP28606',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'I-Pace',
 'odometer': 46400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar I-Pace electric drive 294 kW HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2022}
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP28606%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.es] INFO: Saving data for EP28606: {'auction_closing_time': 1765037262.0, 'created_time': 1764850450.780607, 'last_price_update_time': 1764954066.153879}
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP28606') HTTP/1.1" 204 0
2025-12-05 17:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c02ae4c-939c-5e11-a572-d3b54c39ff8f with identifier: WF84546
2025-12-05 17:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c02ae4c-939c-5e11-a572-d3b54c39ff8f with scrape type 2
2025-12-05 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c02ae4c-939c-5e11-a572-d3b54c39ff8f with scrape type 2
2025-12-05 17:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c02ae4c-939c-5e11-a572-d3b54c39ff8f, identifier: WF84546
2025-12-05 17:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784
2025-12-05 17:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3990a2cb-8881-5446-b576-3be4d54fac77 with scrape type 2
2025-12-05 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3990a2cb-8881-5446-b576-3be4d54fac77 with scrape type 2
2025-12-05 17:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3990a2cb-8881-5446-b576-3be4d54fac77, identifier: CN49784
2025-12-05 17:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c02ae4c-939c-5e11-a572-d3b54c39ff8f with identifier: WF84546
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2025-12-05 17:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c02ae4c-939c-5e11-a572-d3b54c39ff8f with identifier: WF84546
2025-12-05 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'violet', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 puretech feel business', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 172035, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wf84546', 'expiration_date': '2025-12-06t16:26:22z', 'origin_country_code': 'es', 'trim': 'feel business', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 100, 'id': '2c02ae4c-939c-5e11-a572-d3b54c39ff8f', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 172035}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 100,
     'category': None,
     'color': 'violet',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:26:22z',
     'fuel_type': 'petrol',
     'id': '2c02ae4c-939c-5e11-a572-d3b54c39ff8f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wf84546',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 172035,
     'odometer_in_km': 172035,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 puretech feel business',
     'transmission': 'manual',
     'trim': 'feel business',
     'year': 2017}
2025-12-05 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2c02ae4c-939c-5e11-a572-d3b54c39ff8f spider: auto1.es
2025-12-05 17:01:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2c02ae4c-939c-5e11-a572-d3b54c39ff8f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'violet', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 puretech feel business', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 172035, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wf84546', 'expiration_date': '2025-12-06t16:26:22z', 'origin_country_code': 'es', 'trim': 'feel business', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 100, 'id': '2c02ae4c-939c-5e11-a572-d3b54c39ff8f', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 172035}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 100,
     'category': None,
     'color': 'violet',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:26:22z',
     'fuel_type': 'petrol',
     'id': '2c02ae4c-939c-5e11-a572-d3b54c39ff8f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wf84546',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 172035,
     'odometer_in_km': 172035,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 puretech feel business',
     'transmission': 'manual',
     'trim': 'feel business',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:26:22Z',
 'fuel_type': 'petrol',
 'id': '2c02ae4c-939c-5e11-a572-d3b54c39ff8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF84546',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 172035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 PureTech Feel Business',
 'transmission': 'manual',
 'trim': 'Feel Business',
 'year': 2017}
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF84546%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.es] INFO: Saving data for WF84546: {'auction_closing_time': 1765038382.0, 'created_time': 1764325949.071573, 'last_price_update_time': 1764954066.823817}
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WF84546') HTTP/1.1" 204 0
2025-12-05 17:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784
2025-12-05 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784
2025-12-05 17:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784 to the API
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN49784>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-06T16:43:14Z',
 'fuel_type': 'hybrid',
 'id': '3990a2cb-8881-5446-b576-3be4d54fac77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN49784',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 63411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN49784%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [auto1.es] INFO: Saving data for CN49784: {'auction_closing_time': 1765039394.0, 'created_time': 1763985004.968484, 'last_price_update_time': 1764954067.129428}
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN49784') HTTP/1.1" 204 0
2025-12-05 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW93874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG23268> (referer: https://www.auto1.com/v1/car-details-view/MG23268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12991d15-e12d-54e3-8e06-c0ad913a66c6 with identifier: MG23268
2025-12-05 17:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12991d15-e12d-54e3-8e06-c0ad913a66c6 with scrape type 1
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_10261aa8764c58547988ef8d2d8f7922.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_ebeec21cabd1c8783415768c7639a25b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_11e8f701395afb425b6f27930832102f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_c9cf214cd616526fe52857f305ed2a6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_8936c853083864b3cd8d77556aceac65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_19b1188c21cae4b93e3defff7a0c5577.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_37d6d4446925e99478de5453283c817d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_86afce2342bbb0006d3e3a03b74b7229.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_81760a73853bc8dba99cd76f0075e59e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_5f0246468f220b644548b4f1963cbc0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg not downloaded yet
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_1da1048fb7ee514ff61f887d069a8b47.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg not downloaded yet
2025-12-05 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP00100/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX75121> (referer: https://www.auto1.com/v1/car-details-view/BX75121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737f2eab-1690-5a46-813e-a37bcfc2c405 with identifier: BX75121
2025-12-05 17:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737f2eab-1690-5a46-813e-a37bcfc2c405 with scrape type 2
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 737f2eab-1690-5a46-813e-a37bcfc2c405 with scrape type 2
2025-12-05 17:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 737f2eab-1690-5a46-813e-a37bcfc2c405, identifier: BX75121
2025-12-05 17:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 737f2eab-1690-5a46-813e-a37bcfc2c405 with identifier: BX75121
2025-12-05 17:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 737f2eab-1690-5a46-813e-a37bcfc2c405 with identifier: BX75121
2025-12-05 17:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 737f2eab-1690-5a46-813e-a37bcfc2c405 with identifier: BX75121 to the API
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX75121>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:20:05Z',
 'fuel_type': 'petrol',
 'id': '737f2eab-1690-5a46-813e-a37bcfc2c405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX75121',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 121488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2017}
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX75121%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.es] INFO: Saving data for BX75121: {'auction_closing_time': 1765038005.0, 'created_time': 1764762874.750374, 'last_price_update_time': 1764954069.273657}
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX75121') HTTP/1.1" 204 0
2025-12-05 17:01:09 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 130 pages/min), scraped 39 items (at 39 items/min)
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY80018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS48880> (referer: https://www.auto1.com/v1/car-details-view/PS48880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ33552> (referer: https://www.auto1.com/v1/car-details-view/MZ33552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF00078> (referer: https://www.auto1.com/v1/car-details-view/TF00078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU05151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ15867> (referer: https://www.auto1.com/v1/car-details-view/PZ15867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN26365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc1f390>
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_1da1048fb7ee514ff61f887d069a8b47.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg saved to cache
2025-12-05 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e75ad50>
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_5f0246468f220b644548b4f1963cbc0f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg saved to cache
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03bdbc53-d00d-54c6-ab55-0c0c76b7102c with identifier: PS48880
2025-12-05 17:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03bdbc53-d00d-54c6-ab55-0c0c76b7102c with scrape type 2
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03bdbc53-d00d-54c6-ab55-0c0c76b7102c with scrape type 2
2025-12-05 17:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 03bdbc53-d00d-54c6-ab55-0c0c76b7102c, identifier: PS48880
2025-12-05 17:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 with identifier: MZ33552
2025-12-05 17:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d5e1f8-27d1-52c0-a551-81411ae749d0 with scrape type 2
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d5e1f8-27d1-52c0-a551-81411ae749d0 with scrape type 2
2025-12-05 17:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6d5e1f8-27d1-52c0-a551-81411ae749d0, identifier: MZ33552
2025-12-05 17:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 009cf034-d1c4-5ce9-9576-dac16a95d7d4 with identifier: TF00078
2025-12-05 17:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 009cf034-d1c4-5ce9-9576-dac16a95d7d4 with scrape type 2
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 009cf034-d1c4-5ce9-9576-dac16a95d7d4 with scrape type 2
2025-12-05 17:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 009cf034-d1c4-5ce9-9576-dac16a95d7d4, identifier: TF00078
2025-12-05 17:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe5c0350-b1ac-5650-9acd-e28c998f67ae with identifier: PZ15867
2025-12-05 17:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe5c0350-b1ac-5650-9acd-e28c998f67ae with scrape type 1
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_508e7b56c33704cf098c3cfd06a60621.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_508e7b56c33704cf098c3cfd06a60621.jpg not downloaded yet
2025-12-05 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 03bdbc53-d00d-54c6-ab55-0c0c76b7102c with identifier: PS48880
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 03bdbc53-d00d-54c6-ab55-0c0c76b7102c with identifier: PS48880
2025-12-05 17:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 03bdbc53-d00d-54c6-ab55-0c0c76b7102c with identifier: PS48880 to the API
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS48880>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:41:03Z',
 'fuel_type': 'hybrid',
 'id': '03bdbc53-d00d-54c6-ab55-0c0c76b7102c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS48880',
 'listing': 'auction',
 'location': 'ES, Xirivella, Valencia.',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 8285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Tech',
 'transmission': 'automatic',
 'trim': '2WD Active Tech',
 'year': 2022}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS48880%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.es] INFO: Saving data for PS48880: {'auction_closing_time': 1765039263.0, 'created_time': 1764762220.893156, 'last_price_update_time': 1764954070.879036}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS48880') HTTP/1.1" 204 0
2025-12-05 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 with identifier: MZ33552
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 with identifier: MZ33552
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 35581, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552', 'expiration_date': '2025-12-06t16:00:15z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el rebolledo (alicante)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 35581}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:00:15z',
     'fuel_type': 'petrol',
     'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552',
     'listing': 'auction',
     'location': 'es, el rebolledo (alicante)',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 35581,
     'odometer_in_km': 35581,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 spider: auto1.es
2025-12-05 17:01:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e6d5e1f8-27d1-52c0-a551-81411ae749d0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 35581, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552', 'expiration_date': '2025-12-06t16:00:15z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el rebolledo (alicante)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 35581}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:00:15z',
     'fuel_type': 'petrol',
     'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552',
     'listing': 'auction',
     'location': 'es, el rebolledo (alicante)',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 35581,
     'odometer_in_km': 35581,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:00:15Z',
 'fuel_type': 'petrol',
 'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ33552',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 35581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ33552%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.es] INFO: Saving data for MZ33552: {'auction_closing_time': 1765036815.0, 'created_time': 1764761787.424184, 'last_price_update_time': 1764954071.100913}
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ33552') HTTP/1.1" 204 0
2025-12-05 17:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 009cf034-d1c4-5ce9-9576-dac16a95d7d4 with identifier: TF00078
2025-12-05 17:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 009cf034-d1c4-5ce9-9576-dac16a95d7d4 with identifier: TF00078
2025-12-05 17:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 009cf034-d1c4-5ce9-9576-dac16a95d7d4 with identifier: TF00078 to the API
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF00078>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:51:53Z',
 'fuel_type': 'petrol',
 'id': '009cf034-d1c4-5ce9-9576-dac16a95d7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF00078',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'BMW',
 'model': '1er',
 'odometer': 75490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF00078%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.es] INFO: Saving data for TF00078: {'auction_closing_time': 1765039913.0, 'created_time': 1764763000.292284, 'last_price_update_time': 1764954071.570282}
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF00078') HTTP/1.1" 204 0
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_0dc3252e9f12642cfa36b395683f278f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0dc3252e9f12642cfa36b395683f278f.jpg not downloaded yet
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ91791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_a3503f52f71a16d1347116c3a67718ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_a3503f52f71a16d1347116c3a67718ed.jpg not downloaded yet
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_6f8c595e0614944cc07c8a9b8f326fec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_6f8c595e0614944cc07c8a9b8f326fec.jpg not downloaded yet
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_0589a22f168065dbec98b547612cb040.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0589a22f168065dbec98b547612cb040.jpg not downloaded yet
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_5083e0f0bc9403b1c21ef2587f38006d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_5083e0f0bc9403b1c21ef2587f38006d.jpg not downloaded yet
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_7ed24a13278a37990dbf11dafde88c66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_7ed24a13278a37990dbf11dafde88c66.jpg not downloaded yet
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_508e7b56c33704cf098c3cfd06a60621.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7fa210>
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_37d6d4446925e99478de5453283c817d.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg saved to cache
2025-12-05 17:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71fbd0>
2025-12-05 17:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_81760a73853bc8dba99cd76f0075e59e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg saved to cache
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668daf0710>
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg saved to cache
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e756690>
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_86afce2342bbb0006d3e3a03b74b7229.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg saved to cache
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0dc3252e9f12642cfa36b395683f278f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_bad8267d6adfc9f4eae80d3eb56f6f45.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_bad8267d6adfc9f4eae80d3eb56f6f45.jpg not downloaded yet
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT47052> (referer: https://www.auto1.com/v1/car-details-view/AT47052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ93012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e566f90>
2025-12-05 17:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg saved to cache
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_e6eee4d729dfea6eebbe3f1bb0815fb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_e6eee4d729dfea6eebbe3f1bb0815fb1.jpg not downloaded yet
2025-12-05 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK29781> (referer: https://www.auto1.com/v1/car-details-view/PK29781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e720510>
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg saved to cache
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfc110>
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_19b1188c21cae4b93e3defff7a0c5577.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg saved to cache
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e69ae90>
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_8936c853083864b3cd8d77556aceac65.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg saved to cache
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e69afd0>
2025-12-05 17:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_508e7b56c33704cf098c3cfd06a60621.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_508e7b56c33704cf098c3cfd06a60621.jpg saved to cache
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_5083e0f0bc9403b1c21ef2587f38006d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_7ed24a13278a37990dbf11dafde88c66.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_f2e617282c65b146ccb4e95e9057f67e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_f2e617282c65b146ccb4e95e9057f67e.jpg not downloaded yet
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU43492> (referer: https://www.auto1.com/v1/car-details-view/PU43492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU89529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP00100> (referer: https://www.auto1.com/v1/car-details-view/WP00100/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dadccd0>
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_0dc3252e9f12642cfa36b395683f278f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0dc3252e9f12642cfa36b395683f278f.jpg saved to cache
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f2950>
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg saved to cache
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6c6bd0>
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg saved to cache
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 with identifier: AT47052
2025-12-05 17:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 with scrape type 1
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_858deed4be0e8e2297bb123a3c4c29ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_858deed4be0e8e2297bb123a3c4c29ac.jpg not downloaded yet
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT42449> (referer: https://www.auto1.com/v1/car-details-view/PT42449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e44bd50>
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_c9cf214cd616526fe52857f305ed2a6f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg saved to cache
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da9dc90>
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_11e8f701395afb425b6f27930832102f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg saved to cache
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with identifier: PK29781
2025-12-05 17:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with scrape type 2
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with scrape type 2
2025-12-05 17:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee, identifier: PK29781
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0589a22f168065dbec98b547612cb040.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_6f8c595e0614944cc07c8a9b8f326fec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_bad8267d6adfc9f4eae80d3eb56f6f45.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_a3503f52f71a16d1347116c3a67718ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_1ca0b1f2295ffd2fffc21343f15f103c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_1ca0b1f2295ffd2fffc21343f15f103c.jpg not downloaded yet
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_fea9e79cd44e59e1fad658d2ace5e5db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fea9e79cd44e59e1fad658d2ace5e5db.jpg not downloaded yet
2025-12-05 17:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with identifier: PK29781
2025-12-05 17:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with identifier: PK29781
2025-12-05 17:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 199491 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199491
2025-12-05 17:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee spider: auto1.es
2025-12-05 17:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee due to rule: high_mileage_for_country.json, error: 199491 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199491
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:36:14Z',
 'fuel_type': 'diesel',
 'id': '2f27d4f7-5eb8-57ad-8060-fa110d4462ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK29781',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 199491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2018}
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK29781%27 HTTP/1.1" 200 None
2025-12-05 17:01:16 [auto1.es] INFO: Saving data for PK29781: {'auction_closing_time': 1765038974.0, 'created_time': 1764050449.334387, 'last_price_update_time': 1764954076.063149}
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK29781') HTTP/1.1" 204 0
2025-12-05 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e60c5d0>
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_5083e0f0bc9403b1c21ef2587f38006d.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_5083e0f0bc9403b1c21ef2587f38006d.jpg saved to cache
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da702d0>
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_7ed24a13278a37990dbf11dafde88c66.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_7ed24a13278a37990dbf11dafde88c66.jpg saved to cache
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebf7f00-185b-5d78-bd46-9860211e5474 with identifier: PU43492
2025-12-05 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebf7f00-185b-5d78-bd46-9860211e5474 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ebf7f00-185b-5d78-bd46-9860211e5474 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ebf7f00-185b-5d78-bd46-9860211e5474, identifier: PU43492
2025-12-05 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b581d9-68c1-5af4-b2ae-4f74c70f1997 with identifier: WP00100
2025-12-05 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997 with scrape type 1
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_4694f649f0485dfd937738a84fd2d585.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_4694f649f0485dfd937738a84fd2d585.jpg not downloaded yet
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_b03fe1459d4c496ad51d78e2c7e0c56e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_b03fe1459d4c496ad51d78e2c7e0c56e.jpg not downloaded yet
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_e473202e148a5a26695f56d9e74b2aea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_e473202e148a5a26695f56d9e74b2aea.jpg not downloaded yet
2025-12-05 17:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ebf7f00-185b-5d78-bd46-9860211e5474 with identifier: PU43492
2025-12-05 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ebf7f00-185b-5d78-bd46-9860211e5474 with identifier: PU43492
2025-12-05 17:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ebf7f00-185b-5d78-bd46-9860211e5474 with identifier: PU43492 to the API
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU43492>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:27:41Z',
 'fuel_type': 'petrol',
 'id': '3ebf7f00-185b-5d78-bd46-9860211e5474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU43492',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 86773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2016}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU43492%27 HTTP/1.1" 200 None
2025-12-05 17:01:17 [auto1.es] INFO: Saving data for PU43492: {'auction_closing_time': 1765038461.0, 'created_time': 1764349263.93547, 'last_price_update_time': 1764954077.162569}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PU43492') HTTP/1.1" 204 0
2025-12-05 17:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 089e7b9f-4658-56a7-8675-bfec9c25909d with identifier: PT42449
2025-12-05 17:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089e7b9f-4658-56a7-8675-bfec9c25909d with scrape type 2
2025-12-05 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 089e7b9f-4658-56a7-8675-bfec9c25909d with scrape type 2
2025-12-05 17:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 089e7b9f-4658-56a7-8675-bfec9c25909d, identifier: PT42449
2025-12-05 17:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_e6eee4d729dfea6eebbe3f1bb0815fb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_bb4c972bd2da670dd7fb86eb9ee02fb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_bb4c972bd2da670dd7fb86eb9ee02fb2.jpg not downloaded yet
2025-12-05 17:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN26365> (referer: https://www.auto1.com/v1/car-details-view/DN26365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 089e7b9f-4658-56a7-8675-bfec9c25909d with identifier: PT42449
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 089e7b9f-4658-56a7-8675-bfec9c25909d with identifier: PT42449
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153601 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153601
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 089e7b9f-4658-56a7-8675-bfec9c25909d spider: auto1.es
2025-12-05 17:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 089e7b9f-4658-56a7-8675-bfec9c25909d due to rule: high_mileage_for_country.json, error: 153601 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153601
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:12:49Z',
 'fuel_type': 'diesel',
 'id': '089e7b9f-4658-56a7-8675-bfec9c25909d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT42449',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 153601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2016}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT42449%27 HTTP/1.1" 200 None
2025-12-05 17:01:17 [auto1.es] INFO: Saving data for PT42449: {'auction_closing_time': 1765037569.0, 'created_time': 1764850131.683538, 'last_price_update_time': 1764954077.509421}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PT42449') HTTP/1.1" 204 0
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e836090>
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_0589a22f168065dbec98b547612cb040.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0589a22f168065dbec98b547612cb040.jpg saved to cache
2025-12-05 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e58b010>
2025-12-05 17:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_6f8c595e0614944cc07c8a9b8f326fec.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_6f8c595e0614944cc07c8a9b8f326fec.jpg saved to cache
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e624090>
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_bad8267d6adfc9f4eae80d3eb56f6f45.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_bad8267d6adfc9f4eae80d3eb56f6f45.jpg saved to cache
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db2b8d0>
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_a3503f52f71a16d1347116c3a67718ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_a3503f52f71a16d1347116c3a67718ed.jpg saved to cache
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_858deed4be0e8e2297bb123a3c4c29ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_f2e617282c65b146ccb4e95e9057f67e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_0b8ca1ecc97a6a67b333c920b3f0e9fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0b8ca1ecc97a6a67b333c920b3f0e9fc.jpg not downloaded yet
2025-12-05 17:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb9fd0>
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_10261aa8764c58547988ef8d2d8f7922.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg saved to cache
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e625650>
2025-12-05 17:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F8c%252F738c1cef1a94a9dd4ba5829ffccbb0b6%252Fpa%252FMG23268_ebeec21cabd1c8783415768c7639a25b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg saved to cache
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12991d15-e12d-54e3-8e06-c0ad913a66c6
2025-12-05 17:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12991d15-e12d-54e3-8e06-c0ad913a66c6, skipping ID generation
2025-12-05 17:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12991d15-e12d-54e3-8e06-c0ad913a66c6 with scrape type 1
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 12991d15-e12d-54e3-8e06-c0ad913a66c6 from tracking dictionaries
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12991d15-e12d-54e3-8e06-c0ad913a66c6 sending to next pipeline
2025-12-05 17:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12991d15-e12d-54e3-8e06-c0ad913a66c6, identifier: MG23268
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_8f4387997152f9a2d1637cbc46c99ded.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8f4387997152f9a2d1637cbc46c99ded.jpg not downloaded yet
2025-12-05 17:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12991d15-e12d-54e3-8e06-c0ad913a66c6 with identifier: MG23268
2025-12-05 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12991d15-e12d-54e3-8e06-c0ad913a66c6 with identifier: MG23268
2025-12-05 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 46883, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mg23268', 'expiration_date': '2025-12-06t16:46:50z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, elche', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 98, 'id': '12991d15-e12d-54e3-8e06-c0ad913a66c6', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84840}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60054}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64305}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78467}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79016}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 44368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62262}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 40863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50606}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81953}], 'current_year_diff': 6, 'age_in_months': 76, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 46883}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 76,
     'auction_title': '',
     'c_o_2_emission_value': 98,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2025-12-06t16:46:50z',
     'fuel_type': 'petrol',
     'id': '12991d15-e12d-54e3-8e06-c0ad913a66c6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mg23268',
     'listing': 'auction',
     'location': 'es, elche',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 46883,
     'odometer_in_km': 46883,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 84840,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68599,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76536,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59931,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60054,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73668,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64305,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78467,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79016,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44368,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62262,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67349,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40863,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50606,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51736,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 81953,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
2025-12-05 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 12991d15-e12d-54e3-8e06-c0ad913a66c6 spider: auto1.es
2025-12-05 17:01:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 12991d15-e12d-54e3-8e06-c0ad913a66c6 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 46883, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mg23268', 'expiration_date': '2025-12-06t16:46:50z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, elche', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 98, 'id': '12991d15-e12d-54e3-8e06-c0ad913a66c6', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84840}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60054}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64305}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78467}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79016}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 44368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62262}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 40863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50606}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81953}], 'current_year_diff': 6, 'age_in_months': 76, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 46883}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 76,
     'auction_title': '',
     'c_o_2_emission_value': 98,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2025-12-06t16:46:50z',
     'fuel_type': 'petrol',
     'id': '12991d15-e12d-54e3-8e06-c0ad913a66c6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mg23268',
     'listing': 'auction',
     'location': 'es, elche',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 46883,
     'odometer_in_km': 46883,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 84840,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68599,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76536,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59931,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60054,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73668,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64305,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78467,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79016,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44368,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62262,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67349,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40863,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50606,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51736,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 81953,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:46:50Z',
 'fuel_type': 'petrol',
 'id': '12991d15-e12d-54e3-8e06-c0ad913a66c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG23268',
 'listing': 'auction',
 'location': 'ES, Elche',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 46883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_10261aa8764c58547988ef8d2d8f7922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ebeec21cabd1c8783415768c7639a25b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_11e8f701395afb425b6f27930832102f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_ccbaa77b26049d1fd76bf4bad7907b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_2d4399e1b8fc17ea52b3e414b8c46ff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_c9cf214cd616526fe52857f305ed2a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_b69ce2e8dc9046a87e769e8ecb52a4d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_8936c853083864b3cd8d77556aceac65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_19b1188c21cae4b93e3defff7a0c5577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_50b0b6cacc72252bafa8a37cfa434ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_37d6d4446925e99478de5453283c817d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_21a5aebe25af10b331a0e7e7f4e41d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_86afce2342bbb0006d3e3a03b74b7229.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_81760a73853bc8dba99cd76f0075e59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_5f0246468f220b644548b4f1963cbc0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12991d15-e12d-54e3-8e06-c0ad913a66c6/12991d15-e12d-54e3-8e06-c0ad913a66c6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/8c/738c1cef1a94a9dd4ba5829ffccbb0b6/pa/MG23268_1da1048fb7ee514ff61f887d069a8b47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG23268%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [auto1.es] INFO: Saving data for MG23268: {'created_time': 1764954079.562405, 'last_price_update_time': 1764954079.562416, 'auction_closing_time': 1765039610.0}
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG23268') HTTP/1.1" 204 0
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_005767858ed223b048700fcd18f2213c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_005767858ed223b048700fcd18f2213c.jpg not downloaded yet
2025-12-05 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU05151> (referer: https://www.auto1.com/v1/car-details-view/DU05151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY80018> (referer: https://www.auto1.com/v1/car-details-view/HY80018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71d990>
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_e6eee4d729dfea6eebbe3f1bb0815fb1.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_e6eee4d729dfea6eebbe3f1bb0815fb1.jpg saved to cache
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4e7e33e-e830-5e3d-a471-99a4a63dc6b0 with identifier: DN26365
2025-12-05 17:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4e7e33e-e830-5e3d-a471-99a4a63dc6b0 with scrape type 2
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4e7e33e-e830-5e3d-a471-99a4a63dc6b0 with scrape type 2
2025-12-05 17:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4e7e33e-e830-5e3d-a471-99a4a63dc6b0, identifier: DN26365
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_8fa8b492364e22f6cffd919f319af41d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8fa8b492364e22f6cffd919f319af41d.jpg not downloaded yet
2025-12-05 17:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4e7e33e-e830-5e3d-a471-99a4a63dc6b0 with identifier: DN26365
2025-12-05 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4e7e33e-e830-5e3d-a471-99a4a63dc6b0 with identifier: DN26365
2025-12-05 17:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4e7e33e-e830-5e3d-a471-99a4a63dc6b0 with identifier: DN26365 to the API
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN26365>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:08:44Z',
 'fuel_type': 'petrol',
 'id': 'a4e7e33e-e830-5e3d-a471-99a4a63dc6b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN26365',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 47236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru XV 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2019}
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN26365%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [auto1.es] INFO: Saving data for DN26365: {'auction_closing_time': 1765037324.0, 'created_time': 1761152777.5507, 'last_price_update_time': 1764954080.283786}
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DN26365') HTTP/1.1" 204 0
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ad4d0>
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_858deed4be0e8e2297bb123a3c4c29ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_858deed4be0e8e2297bb123a3c4c29ac.jpg saved to cache
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb3a50>
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_f2e617282c65b146ccb4e95e9057f67e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_f2e617282c65b146ccb4e95e9057f67e.jpg saved to cache
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_b03fe1459d4c496ad51d78e2c7e0c56e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_e473202e148a5a26695f56d9e74b2aea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_4694f649f0485dfd937738a84fd2d585.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_761d9b2b98f7504ec021af3f393318cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_761d9b2b98f7504ec021af3f393318cf.jpg not downloaded yet
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW93874> (referer: https://www.auto1.com/v1/car-details-view/NW93874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_96281b2c15790cb462cde44d90100907.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_96281b2c15790cb462cde44d90100907.jpg not downloaded yet
2025-12-05 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM00245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9033151f-d2af-5a78-a775-a155ac1da785 with identifier: DU05151
2025-12-05 17:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9033151f-d2af-5a78-a775-a155ac1da785 with scrape type 2
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9033151f-d2af-5a78-a775-a155ac1da785 with scrape type 2
2025-12-05 17:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9033151f-d2af-5a78-a775-a155ac1da785, identifier: DU05151
2025-12-05 17:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5717461-708f-5647-9080-3f0c7f7a4cf8 with identifier: HY80018
2025-12-05 17:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5717461-708f-5647-9080-3f0c7f7a4cf8 with scrape type 2
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5717461-708f-5647-9080-3f0c7f7a4cf8 with scrape type 2
2025-12-05 17:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5717461-708f-5647-9080-3f0c7f7a4cf8, identifier: HY80018
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_02b1b2de6b8452f5092566812791a0d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_02b1b2de6b8452f5092566812791a0d0.jpg not downloaded yet
2025-12-05 17:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN45949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ91791> (referer: https://www.auto1.com/v1/car-details-view/BZ91791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE30408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9033151f-d2af-5a78-a775-a155ac1da785 with identifier: DU05151
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9033151f-d2af-5a78-a775-a155ac1da785 with identifier: DU05151
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185538 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185538
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9033151f-d2af-5a78-a775-a155ac1da785 spider: auto1.es
2025-12-05 17:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9033151f-d2af-5a78-a775-a155ac1da785 due to rule: high_mileage_for_country.json, error: 185538 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185538
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:15:48Z',
 'fuel_type': 'diesel',
 'id': '9033151f-d2af-5a78-a775-a155ac1da785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU05151',
 'listing': 'auction',
 'location': 'ES, Castelló de la Plana',
 'make': 'BMW',
 'model': '3er',
 'odometer': 185538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU05151%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [auto1.es] INFO: Saving data for DU05151: {'auction_closing_time': 1765037748.0, 'created_time': 1764223277.326094, 'last_price_update_time': 1764954081.39712}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DU05151') HTTP/1.1" 204 0
2025-12-05 17:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5717461-708f-5647-9080-3f0c7f7a4cf8 with identifier: HY80018
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5717461-708f-5647-9080-3f0c7f7a4cf8 with identifier: HY80018
2025-12-05 17:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c5717461-708f-5647-9080-3f0c7f7a4cf8 with identifier: HY80018 to the API
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY80018>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:17:50Z',
 'fuel_type': 'petrol',
 'id': 'c5717461-708f-5647-9080-3f0c7f7a4cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY80018',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 104827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY80018%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [auto1.es] INFO: Saving data for HY80018: {'auction_closing_time': 1765037870.0, 'created_time': 1761206436.718578, 'last_price_update_time': 1764954081.768448}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HY80018') HTTP/1.1" 204 0
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0b8ca1ecc97a6a67b333c920b3f0e9fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_3195ac9ebf2d0c7594e84da69e97cf46.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_3195ac9ebf2d0c7594e84da69e97cf46.jpg not downloaded yet
2025-12-05 17:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_005767858ed223b048700fcd18f2213c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fea9e79cd44e59e1fad658d2ace5e5db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8f4387997152f9a2d1637cbc46c99ded.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_4083ddfcef76faf8d9b47180c0c1f58e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_4083ddfcef76faf8d9b47180c0c1f58e.jpg not downloaded yet
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ93012> (referer: https://www.auto1.com/v1/car-details-view/YZ93012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db24250>
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_b03fe1459d4c496ad51d78e2c7e0c56e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_b03fe1459d4c496ad51d78e2c7e0c56e.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d941590>
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_e473202e148a5a26695f56d9e74b2aea.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_e473202e148a5a26695f56d9e74b2aea.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7d950>
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_4694f649f0485dfd937738a84fd2d585.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_4694f649f0485dfd937738a84fd2d585.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f08f9e-b415-52e9-b53a-8d605258eb66 with identifier: NW93874
2025-12-05 17:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f08f9e-b415-52e9-b53a-8d605258eb66 with scrape type 2
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62f08f9e-b415-52e9-b53a-8d605258eb66 with scrape type 2
2025-12-05 17:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62f08f9e-b415-52e9-b53a-8d605258eb66, identifier: NW93874
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_bb4c972bd2da670dd7fb86eb9ee02fb2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_abb5b4619fb0324147f5884ef1c27647.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_abb5b4619fb0324147f5884ef1c27647.jpg not downloaded yet
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62f08f9e-b415-52e9-b53a-8d605258eb66 with identifier: NW93874
2025-12-05 17:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62f08f9e-b415-52e9-b53a-8d605258eb66 with identifier: NW93874
2025-12-05 17:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 62f08f9e-b415-52e9-b53a-8d605258eb66 with identifier: NW93874 to the API
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NW93874>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2025-12-06T16:55:25Z',
 'fuel_type': 'diesel',
 'id': '62f08f9e-b415-52e9-b53a-8d605258eb66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW93874',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 64878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW93874%27 HTTP/1.1" 200 None
2025-12-05 17:01:23 [auto1.es] INFO: Saving data for NW93874: {'auction_closing_time': 1765040125.0, 'created_time': 1764762762.566147, 'last_price_update_time': 1764954083.037245}
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW93874') HTTP/1.1" 204 0
2025-12-05 17:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c48f7b5e-3a40-5fc0-897b-49c40b2201d7 with identifier: BZ91791
2025-12-05 17:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c48f7b5e-3a40-5fc0-897b-49c40b2201d7 with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c48f7b5e-3a40-5fc0-897b-49c40b2201d7 with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c48f7b5e-3a40-5fc0-897b-49c40b2201d7, identifier: BZ91791
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_761d9b2b98f7504ec021af3f393318cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_c63d6a4d1f288586dc12dbef18e1589f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c63d6a4d1f288586dc12dbef18e1589f.jpg not downloaded yet
2025-12-05 17:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c48f7b5e-3a40-5fc0-897b-49c40b2201d7 with identifier: BZ91791
2025-12-05 17:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c48f7b5e-3a40-5fc0-897b-49c40b2201d7 with identifier: BZ91791
2025-12-05 17:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c48f7b5e-3a40-5fc0-897b-49c40b2201d7 with identifier: BZ91791 to the API
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BZ91791>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:08:15Z',
 'fuel_type': 'petrol',
 'id': 'c48f7b5e-3a40-5fc0-897b-49c40b2201d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ91791',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 93191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ91791%27 HTTP/1.1" 200 None
2025-12-05 17:01:23 [auto1.es] INFO: Saving data for BZ91791: {'auction_closing_time': 1765037295.0, 'created_time': 1764867634.200926, 'last_price_update_time': 1764954083.560504}
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BZ91791') HTTP/1.1" 204 0
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_1ca0b1f2295ffd2fffc21343f15f103c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8fa8b492364e22f6cffd919f319af41d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_d1060ba5412ede6fdd34a2c660b7ef2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_d1060ba5412ede6fdd34a2c660b7ef2f.jpg not downloaded yet
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e720890>
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_0b8ca1ecc97a6a67b333c920b3f0e9fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0b8ca1ecc97a6a67b333c920b3f0e9fc.jpg saved to cache
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db32ad0>
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_005767858ed223b048700fcd18f2213c.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_005767858ed223b048700fcd18f2213c.jpg saved to cache
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d956910>
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_fea9e79cd44e59e1fad658d2ace5e5db.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fea9e79cd44e59e1fad658d2ace5e5db.jpg saved to cache
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94e850>
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_8f4387997152f9a2d1637cbc46c99ded.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8f4387997152f9a2d1637cbc46c99ded.jpg saved to cache
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d8c27c-4873-5e49-ba60-aca21d5fb571 with identifier: YZ93012
2025-12-05 17:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d8c27c-4873-5e49-ba60-aca21d5fb571 with scrape type 2
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d8c27c-4873-5e49-ba60-aca21d5fb571 with scrape type 2
2025-12-05 17:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62d8c27c-4873-5e49-ba60-aca21d5fb571, identifier: YZ93012
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_02b1b2de6b8452f5092566812791a0d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_96281b2c15790cb462cde44d90100907.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_1b796b303784b4c40beb8632826766fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1b796b303784b4c40beb8632826766fe.jpg not downloaded yet
2025-12-05 17:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62d8c27c-4873-5e49-ba60-aca21d5fb571 with identifier: YZ93012
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62d8c27c-4873-5e49-ba60-aca21d5fb571 with identifier: YZ93012
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 199630 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199630
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 62d8c27c-4873-5e49-ba60-aca21d5fb571 spider: auto1.es
2025-12-05 17:01:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 62d8c27c-4873-5e49-ba60-aca21d5fb571 due to rule: high_mileage_for_country.json, error: 199630 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199630
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:16:05Z',
 'fuel_type': 'petrol',
 'id': '62d8c27c-4873-5e49-ba60-aca21d5fb571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ93012',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 199630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2017}
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ93012%27 HTTP/1.1" 200 None
2025-12-05 17:01:25 [auto1.es] INFO: Saving data for YZ93012: {'auction_closing_time': 1765037765.0, 'created_time': 1764850468.995265, 'last_price_update_time': 1764954085.098699}
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YZ93012') HTTP/1.1" 204 0
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7faa90>
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_bb4c972bd2da670dd7fb86eb9ee02fb2.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_bb4c972bd2da670dd7fb86eb9ee02fb2.jpg saved to cache
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_2a3d788fff318318edaf47eeb1574a8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_2a3d788fff318318edaf47eeb1574a8b.jpg not downloaded yet
2025-12-05 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB95467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL61096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b0510>
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_761d9b2b98f7504ec021af3f393318cf.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_761d9b2b98f7504ec021af3f393318cf.jpg saved to cache
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_3195ac9ebf2d0c7594e84da69e97cf46.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_0c3eec9d2f9fe65b121b758564baf364.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0c3eec9d2f9fe65b121b758564baf364.jpg not downloaded yet
2025-12-05 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM08523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e43d9d0>
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F57%252F6357426bd88f9e075e00f779d1d42daf%252Fpa%252FPZ15867_1ca0b1f2295ffd2fffc21343f15f103c.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_1ca0b1f2295ffd2fffc21343f15f103c.jpg saved to cache
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fe5c0350-b1ac-5650-9acd-e28c998f67ae
2025-12-05 17:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe5c0350-b1ac-5650-9acd-e28c998f67ae, skipping ID generation
2025-12-05 17:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe5c0350-b1ac-5650-9acd-e28c998f67ae with scrape type 1
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fe5c0350-b1ac-5650-9acd-e28c998f67ae from tracking dictionaries
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe5c0350-b1ac-5650-9acd-e28c998f67ae sending to next pipeline
2025-12-05 17:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe5c0350-b1ac-5650-9acd-e28c998f67ae, identifier: PZ15867
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e506890>
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_8fa8b492364e22f6cffd919f319af41d.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8fa8b492364e22f6cffd919f319af41d.jpg saved to cache
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_381f2fc8eb752d53ec5b4996e5a92857.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_381f2fc8eb752d53ec5b4996e5a92857.jpg not downloaded yet
2025-12-05 17:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe5c0350-b1ac-5650-9acd-e28c998f67ae with identifier: PZ15867
2025-12-05 17:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe5c0350-b1ac-5650-9acd-e28c998f67ae with identifier: PZ15867
2025-12-05 17:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
2025-12-05 17:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fe5c0350-b1ac-5650-9acd-e28c998f67ae spider: auto1.es
2025-12-05 17:01:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: fe5c0350-b1ac-5650-9acd-e28c998f67ae due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:36:30Z',
 'fuel_type': 'electro',
 'id': 'fe5c0350-b1ac-5650-9acd-e28c998f67ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ15867',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Toyota',
 'model': 'ProAce City',
 'odometer': 49695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33923,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_508e7b56c33704cf098c3cfd06a60621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33923,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0dc3252e9f12642cfa36b395683f278f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27318,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_a3503f52f71a16d1347116c3a67718ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27318,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_6f8c595e0614944cc07c8a9b8f326fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29379,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_0589a22f168065dbec98b547612cb040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29379,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_5083e0f0bc9403b1c21ef2587f38006d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31741,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_7ed24a13278a37990dbf11dafde88c66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31741,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_bad8267d6adfc9f4eae80d3eb56f6f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51526,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_e6eee4d729dfea6eebbe3f1bb0815fb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51526,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_f2e617282c65b146ccb4e95e9057f67e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50894,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_1ca0b1f2295ffd2fffc21343f15f103c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe5c0350-b1ac-5650-9acd-e28c998f67ae/fe5c0350-b1ac-5650-9acd-e28c998f67ae_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51526,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img63/57/6357426bd88f9e075e00f779d1d42daf/pa/PZ15867_b03fe1459d4c496ad51d78e2c7e0c56e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Toyota ProAce City electric drive 100 kW Combi L2 Electric VX',
 'transmission': 'automatic',
 'trim': 'Combi L2 Electric VX',
 'year': 2022}
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ15867%27 HTTP/1.1" 200 None
2025-12-05 17:01:26 [auto1.es] INFO: Saving data for PZ15867: {'created_time': 1764954086.638423, 'last_price_update_time': 1764954086.638433, 'auction_closing_time': 1765038990.0}
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ15867') HTTP/1.1" 204 0
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5f14d0>
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_02b1b2de6b8452f5092566812791a0d0.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_02b1b2de6b8452f5092566812791a0d0.jpg saved to cache
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5f3a50>
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_96281b2c15790cb462cde44d90100907.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_96281b2c15790cb462cde44d90100907.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c63d6a4d1f288586dc12dbef18e1589f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_af0953644e24196359970fa939344c9a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_af0953644e24196359970fa939344c9a.jpg not downloaded yet
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG47067> (referer: https://www.auto1.com/v1/car-details-view/SG47067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e51bd90>
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_466bff717dcc04582d647e2b88f49579.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_abb5b4619fb0324147f5884ef1c27647.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_1f39c6792319b478711511f0ec5c006f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_1f39c6792319b478711511f0ec5c006f.jpg not downloaded yet
2025-12-05 17:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6ff750>
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_3195ac9ebf2d0c7594e84da69e97cf46.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_3195ac9ebf2d0c7594e84da69e97cf46.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7b8f90>
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_7f82cc8a26bc86698e2717ca5f140861.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1b796b303784b4c40beb8632826766fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_4083ddfcef76faf8d9b47180c0c1f58e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_d1060ba5412ede6fdd34a2c660b7ef2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_fbaebae218d1daea0109910fba31b844.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fbaebae218d1daea0109910fba31b844.jpg not downloaded yet
2025-12-05 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_ae93148a49ee2a5d1e323e0f9262fc60.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_ae93148a49ee2a5d1e323e0f9262fc60.jpg not downloaded yet
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5cd890>
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_c63d6a4d1f288586dc12dbef18e1589f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c63d6a4d1f288586dc12dbef18e1589f.jpg saved to cache
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05574c4f-ed9d-505c-8ae4-fd503992c087 with identifier: SG47067
2025-12-05 17:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05574c4f-ed9d-505c-8ae4-fd503992c087 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05574c4f-ed9d-505c-8ae4-fd503992c087 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05574c4f-ed9d-505c-8ae4-fd503992c087, identifier: SG47067
2025-12-05 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_2a3d788fff318318edaf47eeb1574a8b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_1873e807dc69f50605cfaad97c2ad501.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1873e807dc69f50605cfaad97c2ad501.jpg not downloaded yet
2025-12-05 17:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05574c4f-ed9d-505c-8ae4-fd503992c087 with identifier: SG47067
2025-12-05 17:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05574c4f-ed9d-505c-8ae4-fd503992c087 with identifier: SG47067
2025-12-05 17:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05574c4f-ed9d-505c-8ae4-fd503992c087 with identifier: SG47067 to the API
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG47067>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:38:22Z',
 'fuel_type': 'hybrid',
 'id': '05574c4f-ed9d-505c-8ae4-fd503992c087',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG47067',
 'listing': 'auction',
 'location': 'Palma de Mallorca',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 20664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid Active Plus',
 'transmission': 'automatic',
 'trim': 'Active Plus',
 'year': 2023}
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG47067%27 HTTP/1.1" 200 None
2025-12-05 17:01:28 [auto1.es] INFO: Saving data for SG47067: {'auction_closing_time': 1765039102.0, 'created_time': 1764761816.270965, 'last_price_update_time': 1764954088.719261}
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG47067') HTTP/1.1" 204 0
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e544b90>
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_abb5b4619fb0324147f5884ef1c27647.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_abb5b4619fb0324147f5884ef1c27647.jpg saved to cache
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0c3eec9d2f9fe65b121b758564baf364.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_536d367835d1d3884407c17777a79203.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_536d367835d1d3884407c17777a79203.jpg not downloaded yet
2025-12-05 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_af0953644e24196359970fa939344c9a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_381f2fc8eb752d53ec5b4996e5a92857.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_c7e90112f1b60490b447c8704e47c014.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c7e90112f1b60490b447c8704e47c014.jpg not downloaded yet
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061ac90>
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_1b796b303784b4c40beb8632826766fe.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1b796b303784b4c40beb8632826766fe.jpg saved to cache
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba2950>
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_4083ddfcef76faf8d9b47180c0c1f58e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_4083ddfcef76faf8d9b47180c0c1f58e.jpg saved to cache
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6adf50>
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_d1060ba5412ede6fdd34a2c660b7ef2f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_d1060ba5412ede6fdd34a2c660b7ef2f.jpg saved to cache
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668daf26d0>
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_eeb3abb21740d23da11f369dbeff4078.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg saved to cache
2025-12-05 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_34deb8f80659109b10eae6a7cfec25b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_34deb8f80659109b10eae6a7cfec25b6.jpg not downloaded yet
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU89529> (referer: https://www.auto1.com/v1/car-details-view/DU89529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4e76d0>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_2a3d788fff318318edaf47eeb1574a8b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_2a3d788fff318318edaf47eeb1574a8b.jpg saved to cache
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_fc37f4093094756c3587dc231ca71bf4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fc37f4093094756c3587dc231ca71bf4.jpg not downloaded yet
2025-12-05 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fbaebae218d1daea0109910fba31b844.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_5e3ab6a05e2d32ec171763de0b47f8da.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5e3ab6a05e2d32ec171763de0b47f8da.jpg not downloaded yet
2025-12-05 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC59926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN45949> (referer: https://www.auto1.com/v1/car-details-view/ZN45949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH83553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM00245> (referer: https://www.auto1.com/v1/car-details-view/EM00245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE30408> (referer: https://www.auto1.com/v1/car-details-view/NE30408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e605250>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_0c3eec9d2f9fe65b121b758564baf364.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0c3eec9d2f9fe65b121b758564baf364.jpg saved to cache
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e45b750>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_af0953644e24196359970fa939344c9a.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_af0953644e24196359970fa939344c9a.jpg saved to cache
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e585810>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_381f2fc8eb752d53ec5b4996e5a92857.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_381f2fc8eb752d53ec5b4996e5a92857.jpg saved to cache
2025-12-05 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_ae93148a49ee2a5d1e323e0f9262fc60.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af9b2ea3-a373-51db-96b2-62a2da370353 with identifier: DU89529
2025-12-05 17:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af9b2ea3-a373-51db-96b2-62a2da370353 with scrape type 2
2025-12-05 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af9b2ea3-a373-51db-96b2-62a2da370353 with scrape type 2
2025-12-05 17:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af9b2ea3-a373-51db-96b2-62a2da370353, identifier: DU89529
2025-12-05 17:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1873e807dc69f50605cfaad97c2ad501.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_5774a83e43788f842522decc9ae41841.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5774a83e43788f842522decc9ae41841.jpg not downloaded yet
2025-12-05 17:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af9b2ea3-a373-51db-96b2-62a2da370353 with identifier: DU89529
2025-12-05 17:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af9b2ea3-a373-51db-96b2-62a2da370353 with identifier: DU89529
2025-12-05 17:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2025-12-05 17:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: af9b2ea3-a373-51db-96b2-62a2da370353 spider: auto1.es
2025-12-05 17:01:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: af9b2ea3-a373-51db-96b2-62a2da370353 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:40:06Z',
 'fuel_type': 'diesel',
 'id': 'af9b2ea3-a373-51db-96b2-62a2da370353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU89529',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 45383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi EcoBlue L1 Trend',
 'transmission': 'manual',
 'trim': 'L1 Trend',
 'year': 2023}
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU89529%27 HTTP/1.1" 200 None
2025-12-05 17:01:31 [auto1.es] INFO: Saving data for DU89529: {'auction_closing_time': 1765039206.0, 'created_time': 1762840906.748889, 'last_price_update_time': 1764954091.846932}
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DU89529') HTTP/1.1" 204 0
2025-12-05 17:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_1f39c6792319b478711511f0ec5c006f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH39683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:31 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47cb90>
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_fbaebae218d1daea0109910fba31b844.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fbaebae218d1daea0109910fba31b844.jpg saved to cache
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f4467bf-18c8-5f0b-a747-b10ecdcce02e with identifier: ZN45949
2025-12-05 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f4467bf-18c8-5f0b-a747-b10ecdcce02e with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f4467bf-18c8-5f0b-a747-b10ecdcce02e with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f4467bf-18c8-5f0b-a747-b10ecdcce02e, identifier: ZN45949
2025-12-05 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c98a03a-e209-5c87-a57d-0e8c19b1abd6 with identifier: EM00245
2025-12-05 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c98a03a-e209-5c87-a57d-0e8c19b1abd6 with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c98a03a-e209-5c87-a57d-0e8c19b1abd6 with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c98a03a-e209-5c87-a57d-0e8c19b1abd6, identifier: EM00245
2025-12-05 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408
2025-12-05 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596c59c0-1e88-5b98-b014-9a69b533370d with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596c59c0-1e88-5b98-b014-9a69b533370d with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 596c59c0-1e88-5b98-b014-9a69b533370d, identifier: NE30408
2025-12-05 17:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c7e90112f1b60490b447c8704e47c014.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f4467bf-18c8-5f0b-a747-b10ecdcce02e with identifier: ZN45949
2025-12-05 17:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f4467bf-18c8-5f0b-a747-b10ecdcce02e with identifier: ZN45949
2025-12-05 17:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f4467bf-18c8-5f0b-a747-b10ecdcce02e with identifier: ZN45949 to the API
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN45949>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2025-12-06T16:08:06Z',
 'fuel_type': 'petrol',
 'id': '3f4467bf-18c8-5f0b-a747-b10ecdcce02e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN45949',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 112171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Link BlueDrive 2WD',
 'transmission': 'manual',
 'trim': 'Link BlueDrive 2WD',
 'year': 2018}
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN45949%27 HTTP/1.1" 200 None
2025-12-05 17:01:32 [auto1.es] INFO: Saving data for ZN45949: {'auction_closing_time': 1765037286.0, 'created_time': 1761112832.045179, 'last_price_update_time': 1764954092.798422}
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN45949') HTTP/1.1" 204 0
2025-12-05 17:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c98a03a-e209-5c87-a57d-0e8c19b1abd6 with identifier: EM00245
2025-12-05 17:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c98a03a-e209-5c87-a57d-0e8c19b1abd6 with identifier: EM00245
2025-12-05 17:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c98a03a-e209-5c87-a57d-0e8c19b1abd6 with identifier: EM00245 to the API
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM00245>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:32:23Z',
 'fuel_type': 'petrol',
 'id': '0c98a03a-e209-5c87-a57d-0e8c19b1abd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM00245',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Fiat',
 'model': '500',
 'odometer': 32311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM00245%27 HTTP/1.1" 200 None
2025-12-05 17:01:33 [auto1.es] INFO: Saving data for EM00245: {'auction_closing_time': 1765038743.0, 'created_time': 1761584883.391961, 'last_price_update_time': 1764954093.185438}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM00245') HTTP/1.1" 204 0
2025-12-05 17:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408
2025-12-05 17:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408 to the API
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE30408>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:55:43Z',
 'fuel_type': 'hybrid',
 'id': '596c59c0-1e88-5b98-b014-9a69b533370d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE30408',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 69109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE30408%27 HTTP/1.1" 200 None
2025-12-05 17:01:33 [auto1.es] INFO: Saving data for NE30408: {'auction_closing_time': 1765040143.0, 'created_time': 1764762013.561473, 'last_price_update_time': 1764954093.541891}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NE30408') HTTP/1.1" 204 0
2025-12-05 17:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e635310>
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_ae93148a49ee2a5d1e323e0f9262fc60.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_ae93148a49ee2a5d1e323e0f9262fc60.jpg saved to cache
2025-12-05 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_34deb8f80659109b10eae6a7cfec25b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_536d367835d1d3884407c17777a79203.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:33 [auto1.es] INFO: Found listing with ID: ME35237
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME35237%27 HTTP/1.1" 200 None
2025-12-05 17:01:33 [auto1.es] INFO: Scrape type for ME35237: 0
2025-12-05 17:01:33 [auto1.es] INFO: Found listing with ID: DY13612
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY13612%27 HTTP/1.1" 200 None
2025-12-05 17:01:33 [auto1.es] INFO: Scrape type for DY13612: 2
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b9ed0>
2025-12-05 17:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_1873e807dc69f50605cfaad97c2ad501.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1873e807dc69f50605cfaad97c2ad501.jpg saved to cache
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fc37f4093094756c3587dc231ca71bf4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66914cb810>
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_1f39c6792319b478711511f0ec5c006f.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_1f39c6792319b478711511f0ec5c006f.jpg saved to cache
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5e3ab6a05e2d32ec171763de0b47f8da.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [auto1.es] INFO: Found listing with ID: BY86795
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY86795%27 HTTP/1.1" 200 None
2025-12-05 17:01:34 [auto1.es] INFO: Scrape type for BY86795: 2
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5f1390>
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_c7e90112f1b60490b447c8704e47c014.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c7e90112f1b60490b447c8704e47c014.jpg saved to cache
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e44bc10>
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_34deb8f80659109b10eae6a7cfec25b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_34deb8f80659109b10eae6a7cfec25b6.jpg saved to cache
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e462810>
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_536d367835d1d3884407c17777a79203.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_536d367835d1d3884407c17777a79203.jpg saved to cache
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5774a83e43788f842522decc9ae41841.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:35 [auto1.es] INFO: Found listing with ID: MD64128
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD64128%27 HTTP/1.1" 200 None
2025-12-05 17:01:35 [auto1.es] INFO: Scrape type for MD64128: 0
2025-12-05 17:01:35 [auto1.es] INFO: Found listing with ID: DG00377
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG00377%27 HTTP/1.1" 200 None
2025-12-05 17:01:35 [auto1.es] INFO: Scrape type for DG00377: 2
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e502a90>
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg saved to cache
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e1b90>
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg saved to cache
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab5390>
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F46%252F4646bc111b22b6773f171befc50e3a26%252Fpa%252FWG87489_09c649f446b586906caeea82c70053d9.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg saved to cache
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba
2025-12-05 17:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93660625-fa4c-57cc-a5a3-eb0111f4fcba, skipping ID generation
2025-12-05 17:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba with scrape type 1
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 93660625-fa4c-57cc-a5a3-eb0111f4fcba from tracking dictionaries
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93660625-fa4c-57cc-a5a3-eb0111f4fcba sending to next pipeline
2025-12-05 17:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 93660625-fa4c-57cc-a5a3-eb0111f4fcba, identifier: WG87489
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da8ee90>
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3a%252F913a0826a4f30db5ab5633a010a5e323%252Fpa%252FAT47052_fc37f4093094756c3587dc231ca71bf4.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fc37f4093094756c3587dc231ca71bf4.jpg saved to cache
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1
2025-12-05 17:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b4dbe18-a9fd-5c24-8985-510b7ad063e1, skipping ID generation
2025-12-05 17:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 with scrape type 1
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 from tracking dictionaries
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 sending to next pipeline
2025-12-05 17:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b4dbe18-a9fd-5c24-8985-510b7ad063e1, identifier: AT47052
2025-12-05 17:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 93660625-fa4c-57cc-a5a3-eb0111f4fcba with identifier: WG87489
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 93660625-fa4c-57cc-a5a3-eb0111f4fcba with identifier: WG87489
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 129888, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wg87489', 'expiration_date': '2025-12-06t16:21:37z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, finestrat, alicante', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '93660625-fa4c-57cc-a5a3-eb0111f4fcba', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 97126}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86558}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80135}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78067}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82173}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80624}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 98103}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51569}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57457}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77898}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76662}], 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 129888}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': 'rental',
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2025-12-06t16:21:37z',
     'fuel_type': 'petrol',
     'id': '93660625-fa4c-57cc-a5a3-eb0111f4fcba',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wg87489',
     'listing': 'auction',
     'location': 'es, finestrat, alicante',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 129888,
     'odometer_in_km': 129888,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 97126,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86558,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80135,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78067,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82173,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80624,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85476,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 90886,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 98103,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68237,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69903,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87730,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51569,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57457,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77898,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76662,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-09-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2019}
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 93660625-fa4c-57cc-a5a3-eb0111f4fcba spider: auto1.es
2025-12-05 17:01:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 93660625-fa4c-57cc-a5a3-eb0111f4fcba due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 129888, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wg87489', 'expiration_date': '2025-12-06t16:21:37z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, finestrat, alicante', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '93660625-fa4c-57cc-a5a3-eb0111f4fcba', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 97126}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86558}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80135}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78067}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82173}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80624}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 98103}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51569}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57457}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77898}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76662}], 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 129888}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': 'rental',
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2025-12-06t16:21:37z',
     'fuel_type': 'petrol',
     'id': '93660625-fa4c-57cc-a5a3-eb0111f4fcba',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wg87489',
     'listing': 'auction',
     'location': 'es, finestrat, alicante',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 129888,
     'odometer_in_km': 129888,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 97126,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86558,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80135,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78067,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82173,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80624,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85476,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 90886,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 98103,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68237,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69903,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87730,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51569,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57457,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77898,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76662,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-09-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:21:37Z',
 'fuel_type': 'petrol',
 'id': '93660625-fa4c-57cc-a5a3-eb0111f4fcba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG87489',
 'listing': 'auction',
 'location': 'ES, Finestrat, Alicante',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 129888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_6609dfc3192e9c2ee4381132a878f5d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7cb37739235c942dfb1bd28ea1768dd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_09c649f446b586906caeea82c70053d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_5c59ed184177d65c2fbf561e7bc0ae53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_eeb3abb21740d23da11f369dbeff4078.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_588edbc8f41f6bb375c7ac6a49888186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7e547dac98832551c3d9a6442c0aa783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_7f82cc8a26bc86698e2717ca5f140861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_466bff717dcc04582d647e2b88f49579.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9dccacd072a539f61b5d84a52faecf75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_564fbf081d31d651e4c18c7c4a0c0948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_aff8c28f234b553fbf166e4b67b129c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_3b699c78bfd0c582ca9ba2ec6d887d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_95f34092d3a7cba952cecab1bf0d429a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_9f8cec6adaecaf044aaa7760ffb04865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93660625-fa4c-57cc-a5a3-eb0111f4fcba/93660625-fa4c-57cc-a5a3-eb0111f4fcba_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/46/4646bc111b22b6773f171befc50e3a26/pa/WG87489_8581f74b2d57aab4e022fe604483c110.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG87489%27 HTTP/1.1" 200 None
2025-12-05 17:01:36 [auto1.es] INFO: Saving data for WG87489: {'created_time': 1764954096.642548, 'last_price_update_time': 1764954096.642558, 'auction_closing_time': 1765038097.0}
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG87489') HTTP/1.1" 204 0
2025-12-05 17:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 with identifier: AT47052
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 with identifier: AT47052
2025-12-05 17:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b4dbe18-a9fd-5c24-8985-510b7ad063e1 with identifier: AT47052 to the API
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fc37f4093094756c3587dc231ca71bf4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:23:15Z',
 'fuel_type': 'diesel',
 'id': '4b4dbe18-a9fd-5c24-8985-510b7ad063e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT47052',
 'listing': 'auction',
 'location': 'ES, Logroño',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 22161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_858deed4be0e8e2297bb123a3c4c29ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fea9e79cd44e59e1fad658d2ace5e5db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_e473202e148a5a26695f56d9e74b2aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0b8ca1ecc97a6a67b333c920b3f0e9fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_005767858ed223b048700fcd18f2213c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_761d9b2b98f7504ec021af3f393318cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_02b1b2de6b8452f5092566812791a0d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_4083ddfcef76faf8d9b47180c0c1f58e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c63d6a4d1f288586dc12dbef18e1589f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1b796b303784b4c40beb8632826766fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_0c3eec9d2f9fe65b121b758564baf364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_af0953644e24196359970fa939344c9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fbaebae218d1daea0109910fba31b844.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_1873e807dc69f50605cfaad97c2ad501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_c7e90112f1b60490b447c8704e47c014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4dbe18-a9fd-5c24-8985-510b7ad063e1/4b4dbe18-a9fd-5c24-8985-510b7ad063e1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3a/913a0826a4f30db5ab5633a010a5e323/pa/AT47052_fc37f4093094756c3587dc231ca71bf4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT47052%27 HTTP/1.1" 200 None
2025-12-05 17:01:37 [auto1.es] INFO: Saving data for AT47052: {'created_time': 1764954097.002581, 'last_price_update_time': 1764954097.002591, 'auction_closing_time': 1765038195.0}
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT47052') HTTP/1.1" 204 0
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4f4b90>
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_5e3ab6a05e2d32ec171763de0b47f8da.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5e3ab6a05e2d32ec171763de0b47f8da.jpg saved to cache
2025-12-05 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:37 [auto1.es] INFO: Found listing with ID: PF83660
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF83660%27 HTTP/1.1" 200 None
2025-12-05 17:01:37 [auto1.es] INFO: Scrape type for PF83660: 2
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB34403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA99155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY46148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL61096> (referer: https://www.auto1.com/v1/car-details-view/CL61096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM08523> (referer: https://www.auto1.com/v1/car-details-view/WM08523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY41462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7fa690>
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F03%252F0103136a2054e847b467805938dcc40e%252Fpa%252FWP00100_5774a83e43788f842522decc9ae41841.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5774a83e43788f842522decc9ae41841.jpg saved to cache
2025-12-05 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997
2025-12-05 17:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1b581d9-68c1-5af4-b2ae-4f74c70f1997, skipping ID generation
2025-12-05 17:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997 with scrape type 1
2025-12-05 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b1b581d9-68c1-5af4-b2ae-4f74c70f1997 from tracking dictionaries
2025-12-05 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1b581d9-68c1-5af4-b2ae-4f74c70f1997 sending to next pipeline
2025-12-05 17:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1b581d9-68c1-5af4-b2ae-4f74c70f1997, identifier: WP00100
2025-12-05 17:01:37 [auto1.es] INFO: Found listing with ID: MA85857
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA85857%27 HTTP/1.1" 200 None
2025-12-05 17:01:37 [auto1.es] INFO: Scrape type for MA85857: 2
2025-12-05 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB95467> (referer: https://www.auto1.com/v1/car-details-view/FB95467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1b581d9-68c1-5af4-b2ae-4f74c70f1997 with identifier: WP00100
2025-12-05 17:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1b581d9-68c1-5af4-b2ae-4f74c70f1997 with identifier: WP00100
2025-12-05 17:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1b581d9-68c1-5af4-b2ae-4f74c70f1997 with identifier: WP00100 to the API
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5774a83e43788f842522decc9ae41841.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:45:12Z',
 'fuel_type': 'petrol',
 'id': 'b1b581d9-68c1-5af4-b2ae-4f74c70f1997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP00100',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 53544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_4694f649f0485dfd937738a84fd2d585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_bb4c972bd2da670dd7fb86eb9ee02fb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8f4387997152f9a2d1637cbc46c99ded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_8fa8b492364e22f6cffd919f319af41d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_96281b2c15790cb462cde44d90100907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_3195ac9ebf2d0c7594e84da69e97cf46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_abb5b4619fb0324147f5884ef1c27647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_d1060ba5412ede6fdd34a2c660b7ef2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_2a3d788fff318318edaf47eeb1574a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_381f2fc8eb752d53ec5b4996e5a92857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_1f39c6792319b478711511f0ec5c006f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_ae93148a49ee2a5d1e323e0f9262fc60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_536d367835d1d3884407c17777a79203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_34deb8f80659109b10eae6a7cfec25b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5e3ab6a05e2d32ec171763de0b47f8da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b581d9-68c1-5af4-b2ae-4f74c70f1997/b1b581d9-68c1-5af4-b2ae-4f74c70f1997_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/03/0103136a2054e847b467805938dcc40e/pa/WP00100_5774a83e43788f842522decc9ae41841.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2020}
2025-12-05 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP00100%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Saving data for WP00100: {'created_time': 1764954099.004192, 'last_price_update_time': 1764954099.0042, 'auction_closing_time': 1765039512.0}
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WP00100') HTTP/1.1" 204 0
2025-12-05 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: WF56643
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF56643%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for WF56643: 2
2025-12-05 17:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca465372-b003-53dc-be64-3a7bea5058cf with identifier: CL61096
2025-12-05 17:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca465372-b003-53dc-be64-3a7bea5058cf with scrape type 1
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_102cbb05e64736404b80bbec4330a1ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_102cbb05e64736404b80bbec4330a1ce.jpg not downloaded yet
2025-12-05 17:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 527875a6-a4ed-519d-893b-f4eff90b953a with identifier: WM08523
2025-12-05 17:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 527875a6-a4ed-519d-893b-f4eff90b953a with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 527875a6-a4ed-519d-893b-f4eff90b953a with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 527875a6-a4ed-519d-893b-f4eff90b953a, identifier: WM08523
2025-12-05 17:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 527875a6-a4ed-519d-893b-f4eff90b953a with identifier: WM08523
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 527875a6-a4ed-519d-893b-f4eff90b953a with identifier: WM08523
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 527875a6-a4ed-519d-893b-f4eff90b953a spider: auto1.es
2025-12-05 17:01:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 527875a6-a4ed-519d-893b-f4eff90b953a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2025-12-06T16:58:28Z',
 'fuel_type': 'diesel',
 'id': '527875a6-a4ed-519d-893b-f4eff90b953a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM08523',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 18745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi EcoBlue Wildtrak e-4WD Doppelkabine',
 'transmission': 'automatic',
 'trim': 'Wildtrak e-4WD Doppelkabine',
 'year': 2023}
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM08523%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Saving data for WM08523: {'auction_closing_time': 1765040308.0, 'created_time': 1763658316.736232, 'last_price_update_time': 1764954099.415563}
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WM08523') HTTP/1.1" 204 0
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: WE80954
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE80954%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for WE80954: 0
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: JC29023
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC29023%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for JC29023: 0
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: JJ47642
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ47642%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for JJ47642: 2
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_412d4b67f87f168ef2ea4c376bac6fb9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_412d4b67f87f168ef2ea4c376bac6fb9.jpg not downloaded yet
2025-12-05 17:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d27747-0c80-5f8d-b109-7da0447302c9 with identifier: FB95467
2025-12-05 17:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d27747-0c80-5f8d-b109-7da0447302c9 with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22d27747-0c80-5f8d-b109-7da0447302c9 with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22d27747-0c80-5f8d-b109-7da0447302c9, identifier: FB95467
2025-12-05 17:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22d27747-0c80-5f8d-b109-7da0447302c9 with identifier: FB95467
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22d27747-0c80-5f8d-b109-7da0447302c9 with identifier: FB95467
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156467 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156467
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 22d27747-0c80-5f8d-b109-7da0447302c9 spider: auto1.es
2025-12-05 17:01:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 22d27747-0c80-5f8d-b109-7da0447302c9 due to rule: high_mileage_for_country.json, error: 156467 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156467
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:08:55Z',
 'fuel_type': 'diesel',
 'id': '22d27747-0c80-5f8d-b109-7da0447302c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB95467',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'BMW',
 'model': '1er',
 'odometer': 156467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2016}
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB95467%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Saving data for FB95467: {'auction_closing_time': 1765037335.0, 'created_time': 1763380410.543817, 'last_price_update_time': 1764954099.800158}
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FB95467') HTTP/1.1" 204 0
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: AY03867
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY03867%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for AY03867: 0
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: DR76468
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR76468%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for DR76468: 0
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: PG55242
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG55242%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.es] INFO: Scrape type for PG55242: 2
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_7d8a0a084dc3ceec0496cfbf63209409.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_7d8a0a084dc3ceec0496cfbf63209409.jpg not downloaded yet
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB31576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_102cbb05e64736404b80bbec4330a1ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:39 [auto1.es] INFO: Found listing with ID: YD49691
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD49691%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for YD49691: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_115718ec8b3b2431cb8571652a46e3b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_115718ec8b3b2431cb8571652a46e3b5.jpg not downloaded yet
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: FH30826
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH30826%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for FH30826: 0
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: TN12809
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN12809%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for TN12809: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_b30710aeafef6e751ad039ac166ab348.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_b30710aeafef6e751ad039ac166ab348.jpg not downloaded yet
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_7d8a0a084dc3ceec0496cfbf63209409.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: HL55968
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL55968%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for HL55968: 0
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: CB18960
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB18960%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for CB18960: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_e01d7de6bb312a24081d08abe9f45ed6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_e01d7de6bb312a24081d08abe9f45ed6.jpg not downloaded yet
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: SM50635
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM50635%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for SM50635: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_dbfaefb07208006134f0b4e06eb04882.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_dbfaefb07208006134f0b4e06eb04882.jpg not downloaded yet
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: LJ71374
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ71374%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for LJ71374: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_777e6216fe22d86a5d740afee462af6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_777e6216fe22d86a5d740afee462af6e.jpg not downloaded yet
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db678d0>
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_102cbb05e64736404b80bbec4330a1ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_102cbb05e64736404b80bbec4330a1ce.jpg saved to cache
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_b30710aeafef6e751ad039ac166ab348.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: EB96855
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB96855%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for EB96855: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_5f5506dcd0f04abb5bd88c098a14bf5d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_5f5506dcd0f04abb5bd88c098a14bf5d.jpg not downloaded yet
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY13612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH83553> (referer: https://www.auto1.com/v1/car-details-view/BH83553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE24275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: FP83905
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP83905%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for FP83905: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_112420aa4d191236333aca2854641b0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_112420aa4d191236333aca2854641b0a.jpg not downloaded yet
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY86795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6a2550>
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_7d8a0a084dc3ceec0496cfbf63209409.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_7d8a0a084dc3ceec0496cfbf63209409.jpg saved to cache
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: AS29624
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS29624%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for AS29624: 0
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: JB14186
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB14186%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for JB14186: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_830e916007cd8ca77a191e1c5f756242.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_830e916007cd8ca77a191e1c5f756242.jpg not downloaded yet
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC59926> (referer: https://www.auto1.com/v1/car-details-view/ZC59926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:40 [auto1.es] INFO: Found listing with ID: CZ67726
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ67726%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.es] INFO: Scrape type for CZ67726: 2
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_995512de2570d9d540e28584a0d8b097.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_995512de2570d9d540e28584a0d8b097.jpg not downloaded yet
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6c7dd0>
2025-12-05 17:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_b30710aeafef6e751ad039ac166ab348.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_b30710aeafef6e751ad039ac166ab348.jpg saved to cache
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd36908-31ac-5e08-bb7e-ed8cf3500dee with identifier: BH83553
2025-12-05 17:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd36908-31ac-5e08-bb7e-ed8cf3500dee with scrape type 2
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdd36908-31ac-5e08-bb7e-ed8cf3500dee with scrape type 2
2025-12-05 17:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdd36908-31ac-5e08-bb7e-ed8cf3500dee, identifier: BH83553
2025-12-05 17:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdd36908-31ac-5e08-bb7e-ed8cf3500dee with identifier: BH83553
2025-12-05 17:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdd36908-31ac-5e08-bb7e-ed8cf3500dee with identifier: BH83553
2025-12-05 17:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdd36908-31ac-5e08-bb7e-ed8cf3500dee with identifier: BH83553 to the API
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27fdd36908-31ac-5e08-bb7e-ed8cf3500dee%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id fdd36908-31ac-5e08-bb7e-ed8cf3500dee: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 17:01:40 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 17:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH83553>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:21:29Z',
 'fuel_type': 'diesel',
 'id': 'fdd36908-31ac-5e08-bb7e-ed8cf3500dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH83553',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 114144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH83553%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.es] INFO: Saving data for BH83553: {'auction_closing_time': 1765038089.0, 'created_time': 1764761696.508347, 'last_price_update_time': 1764954101.493513}
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BH83553') HTTP/1.1" 204 0
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_5f5506dcd0f04abb5bd88c098a14bf5d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_777e6216fe22d86a5d740afee462af6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_112420aa4d191236333aca2854641b0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [auto1.es] INFO: Found listing with ID: VJ31289
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ31289%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.es] INFO: Scrape type for VJ31289: 2
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_0bc8667f59e8488d62dd8688153de02d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_0bc8667f59e8488d62dd8688153de02d.jpg not downloaded yet
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG00377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:41 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922c072b-12b0-5cca-82a1-431935c1c039 with identifier: ZC59926
2025-12-05 17:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922c072b-12b0-5cca-82a1-431935c1c039 with scrape type 2
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 922c072b-12b0-5cca-82a1-431935c1c039 with scrape type 2
2025-12-05 17:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 922c072b-12b0-5cca-82a1-431935c1c039, identifier: ZC59926
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_830e916007cd8ca77a191e1c5f756242.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [auto1.es] INFO: Found listing with ID: CL33221
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL33221%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.es] INFO: Scrape type for CL33221: 2
2025-12-05 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 922c072b-12b0-5cca-82a1-431935c1c039 with identifier: ZC59926
2025-12-05 17:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 922c072b-12b0-5cca-82a1-431935c1c039 with identifier: ZC59926
2025-12-05 17:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176904 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176904
2025-12-05 17:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 922c072b-12b0-5cca-82a1-431935c1c039 spider: auto1.es
2025-12-05 17:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 922c072b-12b0-5cca-82a1-431935c1c039 due to rule: high_mileage_for_country.json, error: 176904 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176904
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:36:41Z',
 'fuel_type': 'diesel',
 'id': '922c072b-12b0-5cca-82a1-431935c1c039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC59926',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 176904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC59926%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.es] INFO: Saving data for ZC59926: {'auction_closing_time': 1765039001.0, 'created_time': 1760438606.011647, 'last_price_update_time': 1764954102.030145}
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC59926') HTTP/1.1" 204 0
2025-12-05 17:01:42 [auto1.es] INFO: Found listing with ID: TU72307
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU72307%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.es] INFO: Scrape type for TU72307: 2
2025-12-05 17:01:42 [auto1.es] INFO: Found listing with ID: BR89368
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR89368%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.es] INFO: Scrape type for BR89368: 1
2025-12-05 17:01:42 [auto1.es] INFO: Found listing with ID: WD55418
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD55418%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.es] INFO: Scrape type for WD55418: 2
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e589090>
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_5f5506dcd0f04abb5bd88c098a14bf5d.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_5f5506dcd0f04abb5bd88c098a14bf5d.jpg saved to cache
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5efdd0>
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_777e6216fe22d86a5d740afee462af6e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_777e6216fe22d86a5d740afee462af6e.jpg saved to cache
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe3190>
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_112420aa4d191236333aca2854641b0a.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_112420aa4d191236333aca2854641b0a.jpg saved to cache
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e53e110>
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_830e916007cd8ca77a191e1c5f756242.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_830e916007cd8ca77a191e1c5f756242.jpg saved to cache
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: PU70685
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU70685%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for PU70685: 2
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_0bc8667f59e8488d62dd8688153de02d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: PJ13054
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ13054%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for PJ13054: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: YV22916
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV22916%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for YV22916: 2
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: XL43054
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL43054%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for XL43054: 2
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY46148> (referer: https://www.auto1.com/v1/car-details-view/ZY46148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA99155> (referer: https://www.auto1.com/v1/car-details-view/RA99155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB34403> (referer: https://www.auto1.com/v1/car-details-view/TB34403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA85857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY41462> (referer: https://www.auto1.com/v1/car-details-view/DY41462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF83660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: HG06033
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG06033%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for HG06033: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: PU65780
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU65780%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for PU65780: 1
2025-12-05 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: FK64256
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK64256%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for FK64256: 2
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: GH37532
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH37532%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for GH37532: 2
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: VT13561
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT13561%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for VT13561: 2
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: JT58561
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT58561%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for JT58561: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: KN50898
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50898%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for KN50898: 2
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e837f90>
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_0bc8667f59e8488d62dd8688153de02d.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_0bc8667f59e8488d62dd8688153de02d.jpg saved to cache
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: GM79434
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM79434%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for GM79434: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: RD97451
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD97451%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for RD97451: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: KZ50055
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ50055%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for KZ50055: 2
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: BX29552
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX29552%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for BX29552: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: VW29974
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW29974%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for VW29974: 2
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: JL18203
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL18203%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for JL18203: 0
2025-12-05 17:01:43 [auto1.es] INFO: Found listing with ID: VA57807
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA57807%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.es] INFO: Scrape type for VA57807: 2
2025-12-05 17:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c480b1fe-a35e-5edd-9681-46e2cdfaa227 with identifier: ZY46148
2025-12-05 17:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c480b1fe-a35e-5edd-9681-46e2cdfaa227 with scrape type 2
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c480b1fe-a35e-5edd-9681-46e2cdfaa227 with scrape type 2
2025-12-05 17:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c480b1fe-a35e-5edd-9681-46e2cdfaa227, identifier: ZY46148
2025-12-05 17:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28128c85-776a-5a80-9632-0f1129864f20 with identifier: RA99155
2025-12-05 17:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28128c85-776a-5a80-9632-0f1129864f20 with scrape type 2
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28128c85-776a-5a80-9632-0f1129864f20 with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 28128c85-776a-5a80-9632-0f1129864f20, identifier: RA99155
2025-12-05 17:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2733b2d-3309-5a5a-b3f3-ea0339dc36c3 with identifier: TB34403
2025-12-05 17:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2733b2d-3309-5a5a-b3f3-ea0339dc36c3 with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2733b2d-3309-5a5a-b3f3-ea0339dc36c3 with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e2733b2d-3309-5a5a-b3f3-ea0339dc36c3, identifier: TB34403
2025-12-05 17:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba71b4ef-0118-5b9b-af95-72d39fa424cf with identifier: DY41462
2025-12-05 17:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba71b4ef-0118-5b9b-af95-72d39fa424cf with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba71b4ef-0118-5b9b-af95-72d39fa424cf with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba71b4ef-0118-5b9b-af95-72d39fa424cf, identifier: DY41462
2025-12-05 17:01:44 [auto1.es] INFO: Found listing with ID: CJ20663
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ20663%27 HTTP/1.1" 200 None
2025-12-05 17:01:44 [auto1.es] INFO: Scrape type for CJ20663: 2
2025-12-05 17:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c480b1fe-a35e-5edd-9681-46e2cdfaa227 with identifier: ZY46148
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c480b1fe-a35e-5edd-9681-46e2cdfaa227 with identifier: ZY46148
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178827 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178827
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c480b1fe-a35e-5edd-9681-46e2cdfaa227 spider: auto1.es
2025-12-05 17:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c480b1fe-a35e-5edd-9681-46e2cdfaa227 due to rule: high_mileage_for_country.json, error: 178827 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178827
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2025-12-06T16:31:43Z',
 'fuel_type': 'diesel',
 'id': 'c480b1fe-a35e-5edd-9681-46e2cdfaa227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY46148',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 178827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY46148%27 HTTP/1.1" 200 None
2025-12-05 17:01:44 [auto1.es] INFO: Saving data for ZY46148: {'auction_closing_time': 1765038703.0, 'created_time': 1764762624.623188, 'last_price_update_time': 1764954104.479266}
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY46148') HTTP/1.1" 204 0
2025-12-05 17:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 28128c85-776a-5a80-9632-0f1129864f20 with identifier: RA99155
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 28128c85-776a-5a80-9632-0f1129864f20 with identifier: RA99155
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace' containing 'proace'
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 28128c85-776a-5a80-9632-0f1129864f20 spider: auto1.es
2025-12-05 17:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 28128c85-776a-5a80-9632-0f1129864f20 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:58:28Z',
 'fuel_type': 'diesel',
 'id': '28128c85-776a-5a80-9632-0f1129864f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA99155',
 'listing': 'auction',
 'location': 'ES, Gandía',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 103576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Toyota ProAce 1.5 D-4D Compact Combi Dynamic',
 'transmission': 'manual',
 'trim': 'Compact Combi Dynamic',
 'year': 2022}
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA99155%27 HTTP/1.1" 200 None
2025-12-05 17:01:44 [auto1.es] INFO: Saving data for RA99155: {'auction_closing_time': 1765040308.0, 'created_time': 1764849826.03959, 'last_price_update_time': 1764954104.808987}
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA99155') HTTP/1.1" 204 0
2025-12-05 17:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e2733b2d-3309-5a5a-b3f3-ea0339dc36c3 with identifier: TB34403
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e2733b2d-3309-5a5a-b3f3-ea0339dc36c3 with identifier: TB34403
2025-12-05 17:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e2733b2d-3309-5a5a-b3f3-ea0339dc36c3 with identifier: TB34403 to the API
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB34403>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:53:02Z',
 'fuel_type': 'diesel',
 'id': 'e2733b2d-3309-5a5a-b3f3-ea0339dc36c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB34403',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 80882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2017}
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB34403%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Saving data for TB34403: {'auction_closing_time': 1765039982.0, 'created_time': 1761732191.540265, 'last_price_update_time': 1764954106.064538}
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB34403') HTTP/1.1" 204 0
2025-12-05 17:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba71b4ef-0118-5b9b-af95-72d39fa424cf with identifier: DY41462
2025-12-05 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba71b4ef-0118-5b9b-af95-72d39fa424cf with identifier: DY41462
2025-12-05 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165716 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165716
2025-12-05 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ba71b4ef-0118-5b9b-af95-72d39fa424cf spider: auto1.es
2025-12-05 17:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ba71b4ef-0118-5b9b-af95-72d39fa424cf due to rule: high_mileage_for_country.json, error: 165716 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165716
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-06T16:34:47Z',
 'fuel_type': 'diesel',
 'id': 'ba71b4ef-0118-5b9b-af95-72d39fa424cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY41462',
 'listing': 'auction',
 'location': 'ES, Amposta',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 165716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 S',
 'transmission': 'automatic',
 'trim': 'TDV6 S',
 'year': 2016}
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY41462%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Saving data for DY41462: {'auction_closing_time': 1765038887.0, 'created_time': 1764762086.650214, 'last_price_update_time': 1764954106.287645}
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DY41462') HTTP/1.1" 204 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: TR17798
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR17798%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for TR17798: 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: CT52857
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT52857%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for CT52857: 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: FH62842
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH62842%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for FH62842: 2
2025-12-05 17:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG55242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH39683> (referer: https://www.auto1.com/v1/car-details-view/RH39683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: NB57932
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB57932%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for NB57932: 2
2025-12-05 17:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: BK94468
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK94468%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for BK94468: 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: MS45572
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS45572%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for MS45572: 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: BL88891
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL88891%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for BL88891: 2
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: HR92037
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR92037%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for HR92037: 2
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: CD67343
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD67343%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for CD67343: 2
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: VA59109
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA59109%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for VA59109: 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: VD39423
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD39423%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for VD39423: 2
2025-12-05 17:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3c1aff-e12a-56d1-83fb-19d8be952c2b with identifier: RH39683
2025-12-05 17:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3c1aff-e12a-56d1-83fb-19d8be952c2b with scrape type 2
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f3c1aff-e12a-56d1-83fb-19d8be952c2b with scrape type 2
2025-12-05 17:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f3c1aff-e12a-56d1-83fb-19d8be952c2b, identifier: RH39683
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: ZX35982
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX35982%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for ZX35982: 0
2025-12-05 17:01:46 [auto1.es] INFO: Found listing with ID: SK56114
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK56114%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.es] INFO: Scrape type for SK56114: 2
2025-12-05 17:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f3c1aff-e12a-56d1-83fb-19d8be952c2b with identifier: RH39683
2025-12-05 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f3c1aff-e12a-56d1-83fb-19d8be952c2b with identifier: RH39683
2025-12-05 17:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f3c1aff-e12a-56d1-83fb-19d8be952c2b with identifier: RH39683 to the API
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RH39683>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2025-12-06T16:09:24Z',
 'fuel_type': 'petrol',
 'id': '3f3c1aff-e12a-56d1-83fb-19d8be952c2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH39683',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 145454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Zenith 2WD',
 'transmission': 'automatic',
 'trim': 'Zenith 2WD',
 'year': 2018}
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH39683%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Saving data for RH39683: {'auction_closing_time': 1765037364.0, 'created_time': 1764850453.785485, 'last_price_update_time': 1764954107.48249}
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RH39683') HTTP/1.1" 204 0
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: UG82404
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG82404%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for UG82404: 0
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: MJ86740
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ86740%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for MJ86740: 0
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: ZF24359
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF24359%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for ZF24359: 1
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB96855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB14186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY86795> (referer: https://www.auto1.com/v1/car-details-view/BY86795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB31576> (referer: https://www.auto1.com/v1/car-details-view/NB31576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: MA53197
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA53197%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for MA53197: 0
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: CN03352
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN03352%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for CN03352: 0
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: WW85834
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW85834%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for WW85834: 2
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE24275> (referer: https://www.auto1.com/v1/car-details-view/XE24275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY13612> (referer: https://www.auto1.com/v1/car-details-view/DY13612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: LJ36949
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ36949%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for LJ36949: 0
2025-12-05 17:01:47 [auto1.es] INFO: Found listing with ID: NB20063
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB20063%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.es] INFO: Scrape type for NB20063: 1
2025-12-05 17:01:47 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:47 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 226, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 336, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2025-12-05 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7082bb4c-f6cc-5d66-b674-73fc80036787 with identifier: BY86795
2025-12-05 17:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7082bb4c-f6cc-5d66-b674-73fc80036787 with scrape type 2
2025-12-05 17:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7082bb4c-f6cc-5d66-b674-73fc80036787 with scrape type 2
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7082bb4c-f6cc-5d66-b674-73fc80036787, identifier: BY86795
2025-12-05 17:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7082bb4c-f6cc-5d66-b674-73fc80036787 with identifier: BY86795
2025-12-05 17:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7082bb4c-f6cc-5d66-b674-73fc80036787 with identifier: BY86795
2025-12-05 17:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7082bb4c-f6cc-5d66-b674-73fc80036787 with identifier: BY86795 to the API
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY86795>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:08:51Z',
 'fuel_type': 'diesel',
 'id': '7082bb4c-f6cc-5d66-b674-73fc80036787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY86795',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 104780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY86795%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.es] INFO: Saving data for BY86795: {'auction_closing_time': 1765037331.0, 'created_time': 1764762457.138282, 'last_price_update_time': 1764954109.484984}
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BY86795') HTTP/1.1" 204 0
2025-12-05 17:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10123d56-9a92-5db8-8544-ac8a3ba55ce2 with identifier: NB31576
2025-12-05 17:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10123d56-9a92-5db8-8544-ac8a3ba55ce2 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10123d56-9a92-5db8-8544-ac8a3ba55ce2 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10123d56-9a92-5db8-8544-ac8a3ba55ce2, identifier: NB31576
2025-12-05 17:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff9f69a-084d-5cf3-b313-28fb88004bd1 with identifier: XE24275
2025-12-05 17:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff9f69a-084d-5cf3-b313-28fb88004bd1 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff9f69a-084d-5cf3-b313-28fb88004bd1 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bff9f69a-084d-5cf3-b313-28fb88004bd1, identifier: XE24275
2025-12-05 17:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623f439b-10ee-5da5-8304-372e39bb7dd6 with identifier: DY13612
2025-12-05 17:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623f439b-10ee-5da5-8304-372e39bb7dd6 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 623f439b-10ee-5da5-8304-372e39bb7dd6 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 623f439b-10ee-5da5-8304-372e39bb7dd6, identifier: DY13612
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ31289/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG00377> (referer: https://www.auto1.com/v1/car-details-view/DG00377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10123d56-9a92-5db8-8544-ac8a3ba55ce2 with identifier: NB31576
2025-12-05 17:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10123d56-9a92-5db8-8544-ac8a3ba55ce2 with identifier: NB31576
2025-12-05 17:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10123d56-9a92-5db8-8544-ac8a3ba55ce2 with identifier: NB31576 to the API
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB31576>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 265,
 'expiration_date': '2025-12-06T16:19:55Z',
 'fuel_type': 'hybrid',
 'id': '10123d56-9a92-5db8-8544-ac8a3ba55ce2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB31576',
 'listing': 'auction',
 'location': 'ES, La Pobla de Valbona',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 11630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid Drive 4WD',
 'transmission': 'automatic',
 'trim': 'Drive 4WD',
 'year': 2023}
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB31576%27 HTTP/1.1" 200 None
2025-12-05 17:01:50 [auto1.es] INFO: Saving data for NB31576: {'auction_closing_time': 1765037995.0, 'created_time': 1764762356.181734, 'last_price_update_time': 1764954110.097352}
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NB31576') HTTP/1.1" 204 0
2025-12-05 17:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bff9f69a-084d-5cf3-b313-28fb88004bd1 with identifier: XE24275
2025-12-05 17:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bff9f69a-084d-5cf3-b313-28fb88004bd1 with identifier: XE24275
2025-12-05 17:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bff9f69a-084d-5cf3-b313-28fb88004bd1 with identifier: XE24275 to the API
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE24275>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:53:15Z',
 'fuel_type': 'petrol',
 'id': 'bff9f69a-084d-5cf3-b313-28fb88004bd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE24275',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 35109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE24275%27 HTTP/1.1" 200 None
2025-12-05 17:01:51 [auto1.es] INFO: Saving data for XE24275: {'auction_closing_time': 1765039995.0, 'created_time': 1763380054.118781, 'last_price_update_time': 1764954111.012499}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XE24275') HTTP/1.1" 204 0
2025-12-05 17:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 623f439b-10ee-5da5-8304-372e39bb7dd6 with identifier: DY13612
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 623f439b-10ee-5da5-8304-372e39bb7dd6 with identifier: DY13612
2025-12-05 17:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 623f439b-10ee-5da5-8304-372e39bb7dd6 with identifier: DY13612 to the API
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY13612>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-06T16:53:53Z',
 'fuel_type': 'diesel',
 'id': '623f439b-10ee-5da5-8304-372e39bb7dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY13612',
 'listing': 'auction',
 'location': 'ES, San Juan de Aznalfarache, Sevilla',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 100163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY13612%27 HTTP/1.1" 200 None
2025-12-05 17:01:51 [auto1.es] INFO: Saving data for DY13612: {'auction_closing_time': 1765040033.0, 'created_time': 1764850889.625489, 'last_price_update_time': 1764954111.338172}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DY13612') HTTP/1.1" 204 0
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU70685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD55418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c243d25-5361-5c1a-9f8b-232b49ed2a86 with identifier: DG00377
2025-12-05 17:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c243d25-5361-5c1a-9f8b-232b49ed2a86 with scrape type 2
2025-12-05 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c243d25-5361-5c1a-9f8b-232b49ed2a86 with scrape type 2
2025-12-05 17:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c243d25-5361-5c1a-9f8b-232b49ed2a86, identifier: DG00377
2025-12-05 17:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c243d25-5361-5c1a-9f8b-232b49ed2a86 with identifier: DG00377
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c243d25-5361-5c1a-9f8b-232b49ed2a86 with identifier: DG00377
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech feel m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'manual', 'odometer': 105313, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg00377', 'expiration_date': '2025-12-06t16:07:20z', 'origin_country_code': 'es', 'trim': 'feel m', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': '3c243d25-5361-5c1a-9f8b-232b49ed2a86', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 105313}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:07:20z',
     'fuel_type': 'petrol',
     'id': '3c243d25-5361-5c1a-9f8b-232b49ed2a86',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg00377',
     'listing': 'auction',
     'location': 'es, calaf - barcelona',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 105313,
     'odometer_in_km': 105313,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-11-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech feel m',
     'transmission': 'manual',
     'trim': 'feel m',
     'year': 2019}
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3c243d25-5361-5c1a-9f8b-232b49ed2a86 spider: auto1.es
2025-12-05 17:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3c243d25-5361-5c1a-9f8b-232b49ed2a86 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech feel m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'manual', 'odometer': 105313, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg00377', 'expiration_date': '2025-12-06t16:07:20z', 'origin_country_code': 'es', 'trim': 'feel m', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': '3c243d25-5361-5c1a-9f8b-232b49ed2a86', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 105313}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:07:20z',
     'fuel_type': 'petrol',
     'id': '3c243d25-5361-5c1a-9f8b-232b49ed2a86',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg00377',
     'listing': 'auction',
     'location': 'es, calaf - barcelona',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 105313,
     'odometer_in_km': 105313,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-11-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech feel m',
     'transmission': 'manual',
     'trim': 'feel m',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:07:20Z',
 'fuel_type': 'petrol',
 'id': '3c243d25-5361-5c1a-9f8b-232b49ed2a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG00377',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 105313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2019}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG00377%27 HTTP/1.1" 200 None
2025-12-05 17:01:51 [auto1.es] INFO: Saving data for DG00377: {'auction_closing_time': 1765037240.0, 'created_time': 1761649842.245082, 'last_price_update_time': 1764954111.65714}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG00377') HTTP/1.1" 204 0
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL43054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV22916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR89368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU72307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK56114/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF24359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH62842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ20663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG55242> (referer: https://www.auto1.com/v1/car-details-view/PG55242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW85834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad7d2790-e355-5734-9025-e292f2fbec2a with identifier: PG55242
2025-12-05 17:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad7d2790-e355-5734-9025-e292f2fbec2a with scrape type 2
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad7d2790-e355-5734-9025-e292f2fbec2a with scrape type 2
2025-12-05 17:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad7d2790-e355-5734-9025-e292f2fbec2a, identifier: PG55242
2025-12-05 17:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad7d2790-e355-5734-9025-e292f2fbec2a with identifier: PG55242
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad7d2790-e355-5734-9025-e292f2fbec2a with identifier: PG55242
2025-12-05 17:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad7d2790-e355-5734-9025-e292f2fbec2a with identifier: PG55242 to the API
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG55242>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2025-12-06T16:45:34Z',
 'fuel_type': 'petrol',
 'id': 'ad7d2790-e355-5734-9025-e292f2fbec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG55242',
 'listing': 'auction',
 'location': 'Torrejon de Ardoz',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 109374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Zenith 2WD',
 'transmission': 'manual',
 'trim': 'Zenith 2WD',
 'year': 2018}
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG55242%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.es] INFO: Saving data for PG55242: {'auction_closing_time': 1765039534.0, 'created_time': 1764761706.13036, 'last_price_update_time': 1764954113.47538}
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PG55242') HTTP/1.1" 204 0
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB14186> (referer: https://www.auto1.com/v1/car-details-view/JB14186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD67343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR92037/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL88891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4bcca4e-ce72-5e33-907f-dd015ca2337e with identifier: JB14186
2025-12-05 17:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bcca4e-ce72-5e33-907f-dd015ca2337e with scrape type 2
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4bcca4e-ce72-5e33-907f-dd015ca2337e with scrape type 2
2025-12-05 17:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4bcca4e-ce72-5e33-907f-dd015ca2337e, identifier: JB14186
2025-12-05 17:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4bcca4e-ce72-5e33-907f-dd015ca2337e with identifier: JB14186
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4bcca4e-ce72-5e33-907f-dd015ca2337e with identifier: JB14186
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech signature', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 70444, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb14186', 'expiration_date': '2025-12-06t16:32:16z', 'origin_country_code': 'es', 'trim': 'signature', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': 'b4bcca4e-ce72-5e33-907f-dd015ca2337e', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70444}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2025-12-06t16:32:16z',
     'fuel_type': 'petrol',
     'id': 'b4bcca4e-ce72-5e33-907f-dd015ca2337e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb14186',
     'listing': 'auction',
     'location': 'es, calaf - barcelona',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 70444,
     'odometer_in_km': 70444,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech signature',
     'transmission': 'manual',
     'trim': 'signature',
     'year': 2019}
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b4bcca4e-ce72-5e33-907f-dd015ca2337e spider: auto1.es
2025-12-05 17:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b4bcca4e-ce72-5e33-907f-dd015ca2337e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech signature', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 70444, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb14186', 'expiration_date': '2025-12-06t16:32:16z', 'origin_country_code': 'es', 'trim': 'signature', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, calaf - barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': 'b4bcca4e-ce72-5e33-907f-dd015ca2337e', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70444}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2025-12-06t16:32:16z',
     'fuel_type': 'petrol',
     'id': 'b4bcca4e-ce72-5e33-907f-dd015ca2337e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb14186',
     'listing': 'auction',
     'location': 'es, calaf - barcelona',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 70444,
     'odometer_in_km': 70444,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech signature',
     'transmission': 'manual',
     'trim': 'signature',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:32:16Z',
 'fuel_type': 'petrol',
 'id': 'b4bcca4e-ce72-5e33-907f-dd015ca2337e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB14186',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 70444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB14186%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.es] INFO: Saving data for JB14186: {'auction_closing_time': 1765038736.0, 'created_time': 1762275684.642541, 'last_price_update_time': 1764954113.893254}
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JB14186') HTTP/1.1" 204 0
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB96855> (referer: https://www.auto1.com/v1/car-details-view/EB96855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD39423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f with identifier: EB96855
2025-12-05 17:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f with scrape type 2
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f with scrape type 2
2025-12-05 17:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f, identifier: EB96855
2025-12-05 17:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f with identifier: EB96855
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f with identifier: EB96855
2025-12-05 17:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ddf0f17-cc8f-5ce9-a87c-98095a94c99f with identifier: EB96855 to the API
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EB96855>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-06T16:47:12Z',
 'fuel_type': 'diesel',
 'id': '0ddf0f17-cc8f-5ce9-a87c-98095a94c99f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB96855',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 146393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.6 CDTI DPF Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2017}
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB96855%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [auto1.es] INFO: Saving data for EB96855: {'auction_closing_time': 1765039632.0, 'created_time': 1764263090.326157, 'last_price_update_time': 1764954114.482433}
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB96855') HTTP/1.1" 204 0
2025-12-05 17:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ31289> (referer: https://www.auto1.com/v1/car-details-view/VJ31289/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL43054> (referer: https://www.auto1.com/v1/car-details-view/XL43054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 with identifier: VJ31289
2025-12-05 17:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 with scrape type 2
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 with scrape type 2
2025-12-05 17:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b4dbeac-86c8-5dc6-a981-5bd236aeb219, identifier: VJ31289
2025-12-05 17:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 with identifier: VJ31289
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 with identifier: VJ31289
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188403 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188403
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 spider: auto1.es
2025-12-05 17:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2b4dbeac-86c8-5dc6-a981-5bd236aeb219 due to rule: high_mileage_for_country.json, error: 188403 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188403
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:36:11Z',
 'fuel_type': 'diesel',
 'id': '2b4dbeac-86c8-5dc6-a981-5bd236aeb219',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ31289',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 188403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ31289%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [auto1.es] INFO: Saving data for VJ31289: {'auction_closing_time': 1765038971.0, 'created_time': 1764761795.831391, 'last_price_update_time': 1764954115.114689}
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ31289') HTTP/1.1" 204 0
2025-12-05 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957b44dd-7e3a-59de-b9f1-5faf20ab853c with identifier: XL43054
2025-12-05 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957b44dd-7e3a-59de-b9f1-5faf20ab853c with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957b44dd-7e3a-59de-b9f1-5faf20ab853c with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 957b44dd-7e3a-59de-b9f1-5faf20ab853c, identifier: XL43054
2025-12-05 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 957b44dd-7e3a-59de-b9f1-5faf20ab853c with identifier: XL43054
2025-12-05 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 957b44dd-7e3a-59de-b9f1-5faf20ab853c with identifier: XL43054
2025-12-05 17:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 957b44dd-7e3a-59de-b9f1-5faf20ab853c with identifier: XL43054 to the API
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL43054>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:53:08Z',
 'fuel_type': 'petrol',
 'id': '957b44dd-7e3a-59de-b9f1-5faf20ab853c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL43054',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 77839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Smart forfour 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL43054%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [auto1.es] INFO: Saving data for XL43054: {'auction_closing_time': 1765039988.0, 'created_time': 1764003720.492385, 'last_price_update_time': 1764954115.543731}
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XL43054') HTTP/1.1" 204 0
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU72307> (referer: https://www.auto1.com/v1/car-details-view/TU72307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK56114> (referer: https://www.auto1.com/v1/car-details-view/SK56114/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD55418> (referer: https://www.auto1.com/v1/car-details-view/WD55418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV22916> (referer: https://www.auto1.com/v1/car-details-view/YV22916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF24359> (referer: https://www.auto1.com/v1/car-details-view/ZF24359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR89368> (referer: https://www.auto1.com/v1/car-details-view/BR89368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c120ae0-6071-53fd-a649-f6b9ba002be5 with identifier: TU72307
2025-12-05 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c120ae0-6071-53fd-a649-f6b9ba002be5 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c120ae0-6071-53fd-a649-f6b9ba002be5 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c120ae0-6071-53fd-a649-f6b9ba002be5, identifier: TU72307
2025-12-05 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9 with identifier: SK56114
2025-12-05 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9, identifier: SK56114
2025-12-05 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c120ae0-6071-53fd-a649-f6b9ba002be5 with identifier: TU72307
2025-12-05 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c120ae0-6071-53fd-a649-f6b9ba002be5 with identifier: TU72307
2025-12-05 17:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c120ae0-6071-53fd-a649-f6b9ba002be5 with identifier: TU72307 to the API
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU72307>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2025-12-06T16:03:20Z',
 'fuel_type': 'diesel',
 'id': '8c120ae0-6071-53fd-a649-f6b9ba002be5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU72307',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 106308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2017}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU72307%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.es] INFO: Saving data for TU72307: {'auction_closing_time': 1765037000.0, 'created_time': 1764867689.392397, 'last_price_update_time': 1764954116.521338}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU72307') HTTP/1.1" 204 0
2025-12-05 17:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9 with identifier: SK56114
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9 with identifier: SK56114
2025-12-05 17:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9 with identifier: SK56114 to the API
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SK56114>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2025-12-06T16:44:01Z',
 'fuel_type': 'hybrid',
 'id': '2b4ef9f0-ac0f-5954-aeb1-f2b8217f1fd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK56114',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '3er',
 'odometer': 22147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2024}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK56114%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.es] INFO: Saving data for SK56114: {'auction_closing_time': 1765039441.0, 'created_time': 1764849588.708399, 'last_price_update_time': 1764954116.878489}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SK56114') HTTP/1.1" 204 0
2025-12-05 17:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ20663> (referer: https://www.auto1.com/v1/car-details-view/CJ20663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ce7e3a-e0f8-5602-be4c-f23bd4c573be with identifier: WD55418
2025-12-05 17:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ce7e3a-e0f8-5602-be4c-f23bd4c573be with scrape type 2
2025-12-05 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ce7e3a-e0f8-5602-be4c-f23bd4c573be with scrape type 2
2025-12-05 17:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f1ce7e3a-e0f8-5602-be4c-f23bd4c573be, identifier: WD55418
2025-12-05 17:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f4f329a-3072-5f2b-9cb0-ed1f836d4558 with identifier: YV22916
2025-12-05 17:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f4f329a-3072-5f2b-9cb0-ed1f836d4558 with scrape type 2
2025-12-05 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f4f329a-3072-5f2b-9cb0-ed1f836d4558 with scrape type 2
2025-12-05 17:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f4f329a-3072-5f2b-9cb0-ed1f836d4558, identifier: YV22916
2025-12-05 17:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 with identifier: ZF24359
2025-12-05 17:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 with scrape type 1
2025-12-05 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg not downloaded yet
2025-12-05 17:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c5734a-01da-5661-8347-cf2374f8af45 with identifier: BR89368
2025-12-05 17:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c5734a-01da-5661-8347-cf2374f8af45 with scrape type 1
2025-12-05 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_d2cfa1fe8999cbaa1ee1c5f2c9d3a871.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_d2cfa1fe8999cbaa1ee1c5f2c9d3a871.jpg not downloaded yet
2025-12-05 17:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH62842> (referer: https://www.auto1.com/v1/car-details-view/FH62842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f1ce7e3a-e0f8-5602-be4c-f23bd4c573be with identifier: WD55418
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f1ce7e3a-e0f8-5602-be4c-f23bd4c573be with identifier: WD55418
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172853
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f1ce7e3a-e0f8-5602-be4c-f23bd4c573be spider: auto1.es
2025-12-05 17:01:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f1ce7e3a-e0f8-5602-be4c-f23bd4c573be due to rule: high_mileage_for_country.json, error: 172853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172853
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:19:16Z',
 'fuel_type': 'diesel',
 'id': 'f1ce7e3a-e0f8-5602-be4c-f23bd4c573be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD55418',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 172853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD55418%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.es] INFO: Saving data for WD55418: {'auction_closing_time': 1765037956.0, 'created_time': 1764003852.003752, 'last_price_update_time': 1764954117.383696}
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WD55418') HTTP/1.1" 204 0
2025-12-05 17:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f4f329a-3072-5f2b-9cb0-ed1f836d4558 with identifier: YV22916
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f4f329a-3072-5f2b-9cb0-ed1f836d4558 with identifier: YV22916
2025-12-05 17:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f4f329a-3072-5f2b-9cb0-ed1f836d4558 with identifier: YV22916 to the API
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV22916>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:59:51Z',
 'fuel_type': 'hybrid',
 'id': '3f4f329a-3072-5f2b-9cb0-ed1f836d4558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV22916',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 100084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2022}
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV22916%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.es] INFO: Saving data for YV22916: {'auction_closing_time': 1765040391.0, 'created_time': 1764867663.253832, 'last_price_update_time': 1764954118.710398}
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YV22916') HTTP/1.1" 204 0
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg not downloaded yet
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_8e9da2a756b95c34d8fe814477e86af9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_8e9da2a756b95c34d8fe814477e86af9.jpg not downloaded yet
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg not downloaded yet
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_a555a58233ec0331b494aa91f70122f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_a555a58233ec0331b494aa91f70122f1.jpg not downloaded yet
2025-12-05 17:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce1c721-5219-54ef-927c-84157ed708d6 with identifier: CJ20663
2025-12-05 17:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce1c721-5219-54ef-927c-84157ed708d6 with scrape type 2
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce1c721-5219-54ef-927c-84157ed708d6 with scrape type 2
2025-12-05 17:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ce1c721-5219-54ef-927c-84157ed708d6, identifier: CJ20663
2025-12-05 17:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4262a2a6-5e07-5dee-beda-50360af808de with identifier: FH62842
2025-12-05 17:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4262a2a6-5e07-5dee-beda-50360af808de with scrape type 2
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4262a2a6-5e07-5dee-beda-50360af808de with scrape type 2
2025-12-05 17:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4262a2a6-5e07-5dee-beda-50360af808de, identifier: FH62842
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_185704bada300860d302e7e0dcf6680a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_185704bada300860d302e7e0dcf6680a.jpg not downloaded yet
2025-12-05 17:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ce1c721-5219-54ef-927c-84157ed708d6 with identifier: CJ20663
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ce1c721-5219-54ef-927c-84157ed708d6 with identifier: CJ20663
2025-12-05 17:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ce1c721-5219-54ef-927c-84157ed708d6 with identifier: CJ20663 to the API
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CJ20663>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 84,
 'expiration_date': '2025-12-06T16:02:10Z',
 'fuel_type': 'petrol',
 'id': '6ce1c721-5219-54ef-927c-84157ed708d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ20663',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 18490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Bayon 1.2 Maxx 2WD',
 'transmission': 'manual',
 'trim': 'Maxx 2WD',
 'year': 2022}
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ20663%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [auto1.es] INFO: Saving data for CJ20663: {'auction_closing_time': 1765036930.0, 'created_time': 1764850013.84298, 'last_price_update_time': 1764954119.406674}
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CJ20663') HTTP/1.1" 204 0
2025-12-05 17:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4262a2a6-5e07-5dee-beda-50360af808de with identifier: FH62842
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4262a2a6-5e07-5dee-beda-50360af808de with identifier: FH62842
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146161 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146161
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 4262a2a6-5e07-5dee-beda-50360af808de spider: auto1.es
2025-12-05 17:01:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4262a2a6-5e07-5dee-beda-50360af808de due to rule: high_mileage_for_make.json, error: 146161 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146161
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:42:30Z',
 'fuel_type': 'diesel',
 'id': '4262a2a6-5e07-5dee-beda-50360af808de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH62842',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 146161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH62842%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [auto1.es] INFO: Saving data for FH62842: {'auction_closing_time': 1765039350.0, 'created_time': 1760461382.692662, 'last_price_update_time': 1764954119.649446}
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH62842') HTTP/1.1" 204 0
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_d2cfa1fe8999cbaa1ee1c5f2c9d3a871.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_b43e340161745b9aff6d78a220141c59.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_83d10ef15cc1d0dcf8a29cc9d162ea1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_83d10ef15cc1d0dcf8a29cc9d162ea1d.jpg not downloaded yet
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB57932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA85857> (referer: https://www.auto1.com/v1/car-details-view/MA85857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF83660> (referer: https://www.auto1.com/v1/car-details-view/PF83660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA57807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU70685> (referer: https://www.auto1.com/v1/car-details-view/PU70685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_d3491a465e9156bd1800df92dd6d3907.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_604db87f93c3a0d47bc114741bd84e28.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_604db87f93c3a0d47bc114741bd84e28.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_2232fce5bab81431be5c6b192bc98023.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_2232fce5bab81431be5c6b192bc98023.jpg not downloaded yet
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW85834> (referer: https://www.auto1.com/v1/car-details-view/WW85834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_12c517778526bdda612fb73b979ea034.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_4c44488afcfc35599a55ef60dd5de29b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_4c44488afcfc35599a55ef60dd5de29b.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_474fc4de67bfec9458019b228b7782c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg not downloaded yet
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_eb1134229abf6d79a22eee6c95ddbc88.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_eb1134229abf6d79a22eee6c95ddbc88.jpg not downloaded yet
2025-12-05 17:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e503f10>
2025-12-05 17:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg saved to cache
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc22250>
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_d2cfa1fe8999cbaa1ee1c5f2c9d3a871.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_d2cfa1fe8999cbaa1ee1c5f2c9d3a871.jpg saved to cache
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_83d10ef15cc1d0dcf8a29cc9d162ea1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_185704bada300860d302e7e0dcf6680a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg not downloaded yet
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_6e2b0afdbaea9b73e706a125319490e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_6e2b0afdbaea9b73e706a125319490e5.jpg not downloaded yet
2025-12-05 17:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1fda972-7190-5d6b-8f48-a7859cd9e252 with identifier: MA85857
2025-12-05 17:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1fda972-7190-5d6b-8f48-a7859cd9e252 with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1fda972-7190-5d6b-8f48-a7859cd9e252 with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1fda972-7190-5d6b-8f48-a7859cd9e252, identifier: MA85857
2025-12-05 17:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9492bd32-56c3-5c3c-8c8b-7738b2466f1f with identifier: PF83660
2025-12-05 17:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9492bd32-56c3-5c3c-8c8b-7738b2466f1f with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9492bd32-56c3-5c3c-8c8b-7738b2466f1f with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9492bd32-56c3-5c3c-8c8b-7738b2466f1f, identifier: PF83660
2025-12-05 17:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e21216b5-6f1b-5489-9da1-80148af05fbf with identifier: PU70685
2025-12-05 17:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e21216b5-6f1b-5489-9da1-80148af05fbf with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e21216b5-6f1b-5489-9da1-80148af05fbf with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e21216b5-6f1b-5489-9da1-80148af05fbf, identifier: PU70685
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_a555a58233ec0331b494aa91f70122f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_8e9da2a756b95c34d8fe814477e86af9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_604db87f93c3a0d47bc114741bd84e28.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1fda972-7190-5d6b-8f48-a7859cd9e252 with identifier: MA85857
2025-12-05 17:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1fda972-7190-5d6b-8f48-a7859cd9e252 with identifier: MA85857
2025-12-05 17:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1fda972-7190-5d6b-8f48-a7859cd9e252 with identifier: MA85857 to the API
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MA85857>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:30:39Z',
 'fuel_type': 'petrol',
 'id': 'b1fda972-7190-5d6b-8f48-a7859cd9e252',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA85857',
 'listing': 'auction',
 'location': 'ES, Vic',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 143693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2016}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA85857%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [auto1.es] INFO: Saving data for MA85857: {'auction_closing_time': 1765038639.0, 'created_time': 1764867661.265811, 'last_price_update_time': 1764954121.160539}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA85857') HTTP/1.1" 204 0
2025-12-05 17:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9492bd32-56c3-5c3c-8c8b-7738b2466f1f with identifier: PF83660
2025-12-05 17:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9492bd32-56c3-5c3c-8c8b-7738b2466f1f with identifier: PF83660
2025-12-05 17:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9492bd32-56c3-5c3c-8c8b-7738b2466f1f with identifier: PF83660 to the API
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF83660>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:27:12Z',
 'fuel_type': 'hybrid',
 'id': '9492bd32-56c3-5c3c-8c8b-7738b2466f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF83660',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 25736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Bussines Plus',
 'transmission': 'automatic',
 'trim': '2WD Bussines Plus',
 'year': 2022}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF83660%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [auto1.es] INFO: Saving data for PF83660: {'auction_closing_time': 1765038432.0, 'created_time': 1764867683.040883, 'last_price_update_time': 1764954121.496322}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PF83660') HTTP/1.1" 204 0
2025-12-05 17:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e21216b5-6f1b-5489-9da1-80148af05fbf with identifier: PU70685
2025-12-05 17:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e21216b5-6f1b-5489-9da1-80148af05fbf with identifier: PU70685
2025-12-05 17:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e21216b5-6f1b-5489-9da1-80148af05fbf with identifier: PU70685 to the API
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU70685>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:41:42Z',
 'fuel_type': 'diesel',
 'id': 'e21216b5-6f1b-5489-9da1-80148af05fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU70685',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 95268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2017}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU70685%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [auto1.es] INFO: Saving data for PU70685: {'auction_closing_time': 1765039302.0, 'created_time': 1764762218.043552, 'last_price_update_time': 1764954121.891322}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PU70685') HTTP/1.1" 204 0
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg not downloaded yet
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_c6e75c5c5ccd14061115e5aa8f5fe985.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_c6e75c5c5ccd14061115e5aa8f5fe985.jpg not downloaded yet
2025-12-05 17:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84263213-b094-5e88-82c4-bf1f187a250e with identifier: WW85834
2025-12-05 17:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84263213-b094-5e88-82c4-bf1f187a250e with scrape type 2
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84263213-b094-5e88-82c4-bf1f187a250e with scrape type 2
2025-12-05 17:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 84263213-b094-5e88-82c4-bf1f187a250e, identifier: WW85834
2025-12-05 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 84263213-b094-5e88-82c4-bf1f187a250e with identifier: WW85834
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 84263213-b094-5e88-82c4-bf1f187a250e with identifier: WW85834
2025-12-05 17:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 84263213-b094-5e88-82c4-bf1f187a250e with identifier: WW85834 to the API
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW85834>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:00:50Z',
 'fuel_type': 'diesel',
 'id': '84263213-b094-5e88-82c4-bf1f187a250e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW85834',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 134141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW85834%27 HTTP/1.1" 200 None
2025-12-05 17:02:02 [auto1.es] INFO: Saving data for WW85834: {'auction_closing_time': 1765036850.0, 'created_time': 1764850460.692546, 'last_price_update_time': 1764954122.403936}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WW85834') HTTP/1.1" 204 0
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_cccf3316f01a7337663d31f7b16f0853.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg not downloaded yet
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_aa860534ed48121b2a618c36ba364f69.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_aa860534ed48121b2a618c36ba364f69.jpg not downloaded yet
2025-12-05 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD39423> (referer: https://www.auto1.com/v1/car-details-view/VD39423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbf8e10>
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_83d10ef15cc1d0dcf8a29cc9d162ea1d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_83d10ef15cc1d0dcf8a29cc9d162ea1d.jpg saved to cache
2025-12-05 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc2ed50>
2025-12-05 17:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_185704bada300860d302e7e0dcf6680a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_185704bada300860d302e7e0dcf6680a.jpg saved to cache
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e761d90>
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_a555a58233ec0331b494aa91f70122f1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_a555a58233ec0331b494aa91f70122f1.jpg saved to cache
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5bdd10>
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg saved to cache
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6f490>
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_8e9da2a756b95c34d8fe814477e86af9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_8e9da2a756b95c34d8fe814477e86af9.jpg saved to cache
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6269d0>
2025-12-05 17:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_b43e340161745b9aff6d78a220141c59.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg saved to cache
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e604e10>
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg saved to cache
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71d050>
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_604db87f93c3a0d47bc114741bd84e28.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_604db87f93c3a0d47bc114741bd84e28.jpg saved to cache
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_2232fce5bab81431be5c6b192bc98023.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_eb1134229abf6d79a22eee6c95ddbc88.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_4c44488afcfc35599a55ef60dd5de29b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg not downloaded yet
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_10a0ea3ef2cb8bb0ec0149378a0abd91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_10a0ea3ef2cb8bb0ec0149378a0abd91.jpg not downloaded yet
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT13561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN50898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR92037> (referer: https://www.auto1.com/v1/car-details-view/HR92037/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ50055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD67343> (referer: https://www.auto1.com/v1/car-details-view/CD67343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW29974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL88891> (referer: https://www.auto1.com/v1/car-details-view/BL88891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a892e591-5dad-5c04-ba3d-060ddf17d4ef with identifier: VD39423
2025-12-05 17:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a892e591-5dad-5c04-ba3d-060ddf17d4ef with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a892e591-5dad-5c04-ba3d-060ddf17d4ef with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a892e591-5dad-5c04-ba3d-060ddf17d4ef, identifier: VD39423
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg not downloaded yet
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_e3a33d5424b9ef425d34c775bdc35b17.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_e3a33d5424b9ef425d34c775bdc35b17.jpg not downloaded yet
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a892e591-5dad-5c04-ba3d-060ddf17d4ef with identifier: VD39423
2025-12-05 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a892e591-5dad-5c04-ba3d-060ddf17d4ef with identifier: VD39423
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146900 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146900
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a892e591-5dad-5c04-ba3d-060ddf17d4ef spider: auto1.es
2025-12-05 17:02:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a892e591-5dad-5c04-ba3d-060ddf17d4ef due to rule: high_mileage_for_make.json, error: 146900 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146900
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:33:58Z',
 'fuel_type': 'petrol',
 'id': 'a892e591-5dad-5c04-ba3d-060ddf17d4ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD39423',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 146900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD39423%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [auto1.es] INFO: Saving data for VD39423: {'auction_closing_time': 1765038838.0, 'created_time': 1764850465.277589, 'last_price_update_time': 1764954125.142274}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VD39423') HTTP/1.1" 204 0
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_6e2b0afdbaea9b73e706a125319490e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg not downloaded yet
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_73d841ec5962b3947be7dfd0d7ceb9ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_73d841ec5962b3947be7dfd0d7ceb9ae.jpg not downloaded yet
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_c6e75c5c5ccd14061115e5aa8f5fe985.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_aa860534ed48121b2a618c36ba364f69.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg not downloaded yet
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_305541c3b14cab21666a7b890b55fbf9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_305541c3b14cab21666a7b890b55fbf9.jpg not downloaded yet
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8a31d0>
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_2232fce5bab81431be5c6b192bc98023.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_2232fce5bab81431be5c6b192bc98023.jpg saved to cache
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b1050>
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_eb1134229abf6d79a22eee6c95ddbc88.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_eb1134229abf6d79a22eee6c95ddbc88.jpg saved to cache
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b7c50>
2025-12-05 17:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_474fc4de67bfec9458019b228b7782c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg saved to cache
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8be610>
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_4c44488afcfc35599a55ef60dd5de29b.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_4c44488afcfc35599a55ef60dd5de29b.jpg saved to cache
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b6d50>
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg saved to cache
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c2b90>
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_12c517778526bdda612fb73b979ea034.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg saved to cache
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c5d90>
2025-12-05 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg saved to cache
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8cb850>
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_d3491a465e9156bd1800df92dd6d3907.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg saved to cache
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec with identifier: HR92037
2025-12-05 17:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec, identifier: HR92037
2025-12-05 17:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7dcc31-0d8d-51e2-a611-674109a943fb with identifier: CD67343
2025-12-05 17:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7dcc31-0d8d-51e2-a611-674109a943fb with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b7dcc31-0d8d-51e2-a611-674109a943fb with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b7dcc31-0d8d-51e2-a611-674109a943fb, identifier: CD67343
2025-12-05 17:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a with identifier: BL88891
2025-12-05 17:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a, identifier: BL88891
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec with identifier: HR92037
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec with identifier: HR92037
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181090 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181090
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec spider: auto1.es
2025-12-05 17:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec due to rule: high_mileage_for_country.json, error: 181090 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181090
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:26:50Z',
 'fuel_type': 'diesel',
 'id': 'e9cf6a3f-2fb3-58a7-9f8e-b4599f0ac6ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR92037',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 181090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro Sport ultra',
 'transmission': 'automatic',
 'trim': 'quattro Sport ultra',
 'year': 2019}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR92037%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.es] INFO: Saving data for HR92037: {'auction_closing_time': 1765038410.0, 'created_time': 1764761656.765198, 'last_price_update_time': 1764954128.095144}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HR92037') HTTP/1.1" 204 0
2025-12-05 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b7dcc31-0d8d-51e2-a611-674109a943fb with identifier: CD67343
2025-12-05 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b7dcc31-0d8d-51e2-a611-674109a943fb with identifier: CD67343
2025-12-05 17:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b7dcc31-0d8d-51e2-a611-674109a943fb with identifier: CD67343 to the API
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD67343>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:58:28Z',
 'fuel_type': 'diesel',
 'id': '5b7dcc31-0d8d-51e2-a611-674109a943fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD67343',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 78840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2016}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD67343%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.es] INFO: Saving data for CD67343: {'auction_closing_time': 1765040308.0, 'created_time': 1763380320.31459, 'last_price_update_time': 1764954128.422627}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CD67343') HTTP/1.1" 204 0
2025-12-05 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a with identifier: BL88891
2025-12-05 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a with identifier: BL88891
2025-12-05 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a spider: auto1.es
2025-12-05 17:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:27:28Z',
 'fuel_type': 'diesel',
 'id': 'ee6675ef-1aa9-5e1a-bf82-67cae71f9b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL88891',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 114899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2020}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL88891%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.es] INFO: Saving data for BL88891: {'auction_closing_time': 1765038448.0, 'created_time': 1764850042.730645, 'last_price_update_time': 1764954128.644737}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BL88891') HTTP/1.1" 204 0
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_995512de2570d9d540e28584a0d8b097.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_10a0ea3ef2cb8bb0ec0149378a0abd91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_e3a33d5424b9ef425d34c775bdc35b17.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:08 [scrapy.extensions.logstats] INFO: Crawled 248 pages (at 118 pages/min), scraped 71 items (at 32 items/min)
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d879f90>
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_6e2b0afdbaea9b73e706a125319490e5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_6e2b0afdbaea9b73e706a125319490e5.jpg saved to cache
2025-12-05 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d848b50>
2025-12-05 17:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_c6e75c5c5ccd14061115e5aa8f5fe985.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_c6e75c5c5ccd14061115e5aa8f5fe985.jpg saved to cache
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d849f90>
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg saved to cache
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71f710>
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_cccf3316f01a7337663d31f7b16f0853.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg saved to cache
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d84aa90>
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg saved to cache
2025-12-05 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e46dd90>
2025-12-05 17:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_aa860534ed48121b2a618c36ba364f69.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_aa860534ed48121b2a618c36ba364f69.jpg saved to cache
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_73d841ec5962b3947be7dfd0d7ceb9ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA57807> (referer: https://www.auto1.com/v1/car-details-view/VA57807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB57932> (referer: https://www.auto1.com/v1/car-details-view/NB57932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH37532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK64256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6a0550>
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_995512de2570d9d540e28584a0d8b097.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_995512de2570d9d540e28584a0d8b097.jpg saved to cache
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc22a50>
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg saved to cache
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5a61d0>
2025-12-05 17:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_10a0ea3ef2cb8bb0ec0149378a0abd91.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_10a0ea3ef2cb8bb0ec0149378a0abd91.jpg saved to cache
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e758dd0>
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_e3a33d5424b9ef425d34c775bdc35b17.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_e3a33d5424b9ef425d34c775bdc35b17.jpg saved to cache
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU65780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL33221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e67a910>
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_73d841ec5962b3947be7dfd0d7ceb9ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_73d841ec5962b3947be7dfd0d7ceb9ae.jpg saved to cache
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d6e10>
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg saved to cache
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7b8d50>
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg saved to cache
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78a7863-10a3-5a25-8240-046c75a0ce46 with identifier: VA57807
2025-12-05 17:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78a7863-10a3-5a25-8240-046c75a0ce46 with scrape type 2
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78a7863-10a3-5a25-8240-046c75a0ce46 with scrape type 2
2025-12-05 17:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e78a7863-10a3-5a25-8240-046c75a0ce46, identifier: VA57807
2025-12-05 17:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8562e73-2220-52bd-80dd-70b9c4b45efc with identifier: NB57932
2025-12-05 17:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8562e73-2220-52bd-80dd-70b9c4b45efc with scrape type 2
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8562e73-2220-52bd-80dd-70b9c4b45efc with scrape type 2
2025-12-05 17:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8562e73-2220-52bd-80dd-70b9c4b45efc, identifier: NB57932
2025-12-05 17:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e78a7863-10a3-5a25-8240-046c75a0ce46 with identifier: VA57807
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e78a7863-10a3-5a25-8240-046c75a0ce46 with identifier: VA57807
2025-12-05 17:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e78a7863-10a3-5a25-8240-046c75a0ce46 with identifier: VA57807 to the API
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VA57807>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'e78a7863-10a3-5a25-8240-046c75a0ce46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA57807',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 135636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA57807%27 HTTP/1.1" 200 None
2025-12-05 17:02:12 [auto1.es] INFO: Saving data for VA57807: {'auction_closing_time': 1765038791.0, 'created_time': 1761631281.059764, 'last_price_update_time': 1764954132.637369}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VA57807') HTTP/1.1" 204 0
2025-12-05 17:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8562e73-2220-52bd-80dd-70b9c4b45efc with identifier: NB57932
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8562e73-2220-52bd-80dd-70b9c4b45efc with identifier: NB57932
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e8562e73-2220-52bd-80dd-70b9c4b45efc spider: auto1.es
2025-12-05 17:02:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e8562e73-2220-52bd-80dd-70b9c4b45efc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:17:05Z',
 'fuel_type': 'diesel',
 'id': 'e8562e73-2220-52bd-80dd-70b9c4b45efc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB57932',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 122733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2017}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB57932%27 HTTP/1.1" 200 None
2025-12-05 17:02:12 [auto1.es] INFO: Saving data for NB57932: {'auction_closing_time': 1765037825.0, 'created_time': 1764050508.338874, 'last_price_update_time': 1764954132.86389}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NB57932') HTTP/1.1" 204 0
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_dbfaefb07208006134f0b4e06eb04882.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_e01d7de6bb312a24081d08abe9f45ed6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_305541c3b14cab21666a7b890b55fbf9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ67726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_115718ec8b3b2431cb8571652a46e3b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_412d4b67f87f168ef2ea4c376bac6fb9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da872d0>
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_dbfaefb07208006134f0b4e06eb04882.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_dbfaefb07208006134f0b4e06eb04882.jpg saved to cache
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbdc7d0>
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_e01d7de6bb312a24081d08abe9f45ed6.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_e01d7de6bb312a24081d08abe9f45ed6.jpg saved to cache
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da09090>
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff0%252F20f09c8c8918f06d013b4fb9d28d10d0%252Fpa%252FZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg saved to cache
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925
2025-12-05 17:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925, skipping ID generation
2025-12-05 17:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 with scrape type 1
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 from tracking dictionaries
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 sending to next pipeline
2025-12-05 17:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925, identifier: ZF24359
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e636dd0>
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fa6%252F98a6e801321aa8dbc65ca6ff95bcb85d%252Fpa%252FBR89368_305541c3b14cab21666a7b890b55fbf9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_305541c3b14cab21666a7b890b55fbf9.jpg saved to cache
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d6c5734a-01da-5661-8347-cf2374f8af45
2025-12-05 17:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6c5734a-01da-5661-8347-cf2374f8af45, skipping ID generation
2025-12-05 17:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c5734a-01da-5661-8347-cf2374f8af45 with scrape type 1
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d6c5734a-01da-5661-8347-cf2374f8af45 from tracking dictionaries
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6c5734a-01da-5661-8347-cf2374f8af45 sending to next pipeline
2025-12-05 17:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6c5734a-01da-5661-8347-cf2374f8af45, identifier: BR89368
2025-12-05 17:02:14 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a3e10>
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_115718ec8b3b2431cb8571652a46e3b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_115718ec8b3b2431cb8571652a46e3b5.jpg saved to cache
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d90d450>
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe0%252F1de0ac804aa198499ef13ce2376a588d%252Fpa%252FCL61096_412d4b67f87f168ef2ea4c376bac6fb9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_412d4b67f87f168ef2ea4c376bac6fb9.jpg saved to cache
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca465372-b003-53dc-be64-3a7bea5058cf
2025-12-05 17:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca465372-b003-53dc-be64-3a7bea5058cf, skipping ID generation
2025-12-05 17:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca465372-b003-53dc-be64-3a7bea5058cf with scrape type 1
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ca465372-b003-53dc-be64-3a7bea5058cf from tracking dictionaries
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca465372-b003-53dc-be64-3a7bea5058cf sending to next pipeline
2025-12-05 17:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca465372-b003-53dc-be64-3a7bea5058cf, identifier: CL61096
2025-12-05 17:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 with identifier: ZF24359
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2025-12-05 17:02:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 with identifier: ZF24359
2025-12-05 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 70571, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zf24359', 'expiration_date': '2025-12-06t16:22:26z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, xirivella, valencia.', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 104450}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 102996}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89381}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87078}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83271}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 103400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91467}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66606}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63197}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74021}], 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 70571}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:22:26z',
     'fuel_type': 'petrol',
     'id': 'dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zf24359',
     'listing': 'auction',
     'location': 'es, xirivella, valencia.',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 70571,
     'odometer_in_km': 70571,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 104450,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 102996,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89381,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87078,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83271,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 103400,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 91467,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101006,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101590,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79867,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79097,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101270,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53867,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66606,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63197,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74021,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2025-12-05 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 spider: auto1.es
2025-12-05 17:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 70571, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zf24359', 'expiration_date': '2025-12-06t16:22:26z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, xirivella, valencia.', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 104450}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 102996}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89381}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87078}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83271}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 103400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91467}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66606}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63197}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74021}], 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 70571}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:22:26z',
     'fuel_type': 'petrol',
     'id': 'dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zf24359',
     'listing': 'auction',
     'location': 'es, xirivella, valencia.',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 70571,
     'odometer_in_km': 70571,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 104450,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 102996,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89381,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87078,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83271,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 103400,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 91467,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101006,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101590,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79867,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79097,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101270,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53867,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66606,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63197,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74021,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:22:26Z',
 'fuel_type': 'petrol',
 'id': 'dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF24359',
 'listing': 'auction',
 'location': 'ES, Xirivella, Valencia.',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 70571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_33c0007c6f010d7449a9c204ad26dd69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_4d94c8e9f30dfc285f3081443b43b67b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_fa7fc7131c93a043c4d50038e0137ff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_9853b1ab5d977522077e6962c50a2cfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_b43e340161745b9aff6d78a220141c59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_d3491a465e9156bd1800df92dd6d3907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_8a1ca8395e4ac67f18e1bbce58767d41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_12c517778526bdda612fb73b979ea034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_474fc4de67bfec9458019b228b7782c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_a195bd674eb6287b1e5ece8662dde5dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_e67779ae01c11ce54adf366b077fe6f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_cccf3316f01a7337663d31f7b16f0853.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_71cbb5a7d01bfedd2c60f11c88547df5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_41a8098e574b537ade3bbcb1ecce0262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_389e0a9096bfcddb1d392607b3e27ff9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925/dfb5d6e4-aea1-5fb1-bc12-6afc49ecb925_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/f0/20f09c8c8918f06d013b4fb9d28d10d0/pa/ZF24359_ef0723795c55bff41771c5cde6e61e8a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF24359%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Saving data for ZF24359: {'created_time': 1764954135.275538, 'last_price_update_time': 1764954135.275548, 'auction_closing_time': 1765038146.0}
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZF24359') HTTP/1.1" 204 0
2025-12-05 17:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6c5734a-01da-5661-8347-cf2374f8af45 with identifier: BR89368
2025-12-05 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6c5734a-01da-5661-8347-cf2374f8af45 with identifier: BR89368
2025-12-05 17:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6c5734a-01da-5661-8347-cf2374f8af45 with identifier: BR89368 to the API
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_305541c3b14cab21666a7b890b55fbf9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:52:08Z',
 'fuel_type': 'petrol',
 'id': 'd6c5734a-01da-5661-8347-cf2374f8af45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR89368',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'BMW',
 'model': '1er',
 'odometer': 102785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_d2cfa1fe8999cbaa1ee1c5f2c9d3a871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_8e9da2a756b95c34d8fe814477e86af9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_a555a58233ec0331b494aa91f70122f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_185704bada300860d302e7e0dcf6680a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_83d10ef15cc1d0dcf8a29cc9d162ea1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_604db87f93c3a0d47bc114741bd84e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_2232fce5bab81431be5c6b192bc98023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_4c44488afcfc35599a55ef60dd5de29b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_eb1134229abf6d79a22eee6c95ddbc88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_6e2b0afdbaea9b73e706a125319490e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_c6e75c5c5ccd14061115e5aa8f5fe985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_aa860534ed48121b2a618c36ba364f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_10a0ea3ef2cb8bb0ec0149378a0abd91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_e3a33d5424b9ef425d34c775bdc35b17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_73d841ec5962b3947be7dfd0d7ceb9ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c5734a-01da-5661-8347-cf2374f8af45/d6c5734a-01da-5661-8347-cf2374f8af45_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/a6/98a6e801321aa8dbc65ca6ff95bcb85d/pa/BR89368_305541c3b14cab21666a7b890b55fbf9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i Edition Sport Line Shadow',
 'transmission': 'manual',
 'trim': 'Edition Sport Line Shadow',
 'year': 2018}
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR89368%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Saving data for BR89368: {'created_time': 1764954135.668893, 'last_price_update_time': 1764954135.668903, 'auction_closing_time': 1765039928.0}
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR89368') HTTP/1.1" 204 0
2025-12-05 17:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca465372-b003-53dc-be64-3a7bea5058cf with identifier: CL61096
2025-12-05 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca465372-b003-53dc-be64-3a7bea5058cf with identifier: CL61096
2025-12-05 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131370 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131370
2025-12-05 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ca465372-b003-53dc-be64-3a7bea5058cf spider: auto1.es
2025-12-05 17:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ca465372-b003-53dc-be64-3a7bea5058cf due to rule: high_mileage_for_make.json, error: 131370 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131370
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:06:04Z',
 'fuel_type': 'diesel',
 'id': 'ca465372-b003-53dc-be64-3a7bea5058cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL61096',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 131370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33783,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_102cbb05e64736404b80bbec4330a1ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33783,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_412d4b67f87f168ef2ea4c376bac6fb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30090,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_7d8a0a084dc3ceec0496cfbf63209409.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30090,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_115718ec8b3b2431cb8571652a46e3b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37132,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_b30710aeafef6e751ad039ac166ab348.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33783,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_e01d7de6bb312a24081d08abe9f45ed6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31386,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_dbfaefb07208006134f0b4e06eb04882.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31386,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_777e6216fe22d86a5d740afee462af6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47201,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_5f5506dcd0f04abb5bd88c098a14bf5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53465,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_112420aa4d191236333aca2854641b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53465,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_830e916007cd8ca77a191e1c5f756242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33311,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_995512de2570d9d540e28584a0d8b097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca465372-b003-53dc-be64-3a7bea5058cf/ca465372-b003-53dc-be64-3a7bea5058cf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56304,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/e0/1de0ac804aa198499ef13ce2376a588d/pa/CL61096_0bc8667f59e8488d62dd8688153de02d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL61096%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Saving data for CL61096: {'created_time': 1764954135.904859, 'last_price_update_time': 1764954135.904868, 'auction_closing_time': 1765037164.0}
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL61096') HTTP/1.1" 204 0
2025-12-05 17:02:15 [auto1.es] INFO: Found listing with ID: XS50446
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50446%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Scrape type for XS50446: 0
2025-12-05 17:02:15 [auto1.es] INFO: Found listing with ID: CT13320
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT13320%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Scrape type for CT13320: 2
2025-12-05 17:02:15 [auto1.es] INFO: Found listing with ID: BX26344
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX26344%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Scrape type for BX26344: 0
2025-12-05 17:02:15 [auto1.es] INFO: Found listing with ID: AJ14674
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ14674%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [auto1.es] INFO: Scrape type for AJ14674: 0
2025-12-05 17:02:15 [auto1.es] INFO: Found listing with ID: RW74191
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW74191%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for RW74191: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: ST53553
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST53553%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for ST53553: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: GU06948
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU06948%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for GU06948: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: KJ22895
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ22895%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for KJ22895: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: TG92089
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG92089%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for TG92089: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: WB56777
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB56777%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for WB56777: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: HV78174
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV78174%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for HV78174: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: ZJ51509
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ51509%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for ZJ51509: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: KK75164
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK75164%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for KK75164: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: ED74766
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED74766%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for ED74766: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: LW02415
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW02415%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for LW02415: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: WX94287
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX94287%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for WX94287: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: UJ79066
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ79066%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for UJ79066: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: MF24732
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF24732%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for MF24732: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: DC72590
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC72590%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for DC72590: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: EF92414
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF92414%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for EF92414: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: XH24581
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH24581%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for XH24581: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: ND01460
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND01460%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for ND01460: 0
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: AJ49177
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ49177%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for AJ49177: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: FV28975
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV28975%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for FV28975: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: DX67476
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX67476%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for DX67476: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: LH71746
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH71746%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for LH71746: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: XE13823
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE13823%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for XE13823: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: TN61769
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN61769%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for TN61769: 1
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: HL98891
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL98891%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for HL98891: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: DY20258
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY20258%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for DY20258: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: BL02071
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL02071%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for BL02071: 1
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: CZ23225
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ23225%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for CZ23225: 1
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: UC57851
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC57851%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for UC57851: 1
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: CW12684
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW12684%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for CW12684: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: FH58137
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH58137%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for FH58137: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: HP20815
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP20815%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for HP20815: 1
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: MW81522
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW81522%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for MW81522: 2
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB18960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: FS87361
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS87361%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for FS87361: 1
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: NH22657
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH22657%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for NH22657: 2
2025-12-05 17:02:16 [auto1.es] INFO: Found listing with ID: TD44553
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD44553%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [auto1.es] INFO: Scrape type for TD44553: 1
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM50635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN50898> (referer: https://www.auto1.com/v1/car-details-view/KN50898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ50055> (referer: https://www.auto1.com/v1/car-details-view/KZ50055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898
2025-12-05 17:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a406fa-3529-5281-ab3d-c0496f1240c4 with scrape type 2
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a406fa-3529-5281-ab3d-c0496f1240c4 with scrape type 2
2025-12-05 17:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95a406fa-3529-5281-ab3d-c0496f1240c4, identifier: KN50898
2025-12-05 17:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898
2025-12-05 17:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898
2025-12-05 17:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898 to the API
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KN50898>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:40:02Z',
 'fuel_type': 'diesel',
 'id': '95a406fa-3529-5281-ab3d-c0496f1240c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN50898',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 42409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50898%27 HTTP/1.1" 200 None
2025-12-05 17:02:17 [auto1.es] INFO: Saving data for KN50898: {'auction_closing_time': 1765039202.0, 'created_time': 1764761927.409332, 'last_price_update_time': 1764954137.226781}
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN50898') HTTP/1.1" 204 0
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP83905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT13561> (referer: https://www.auto1.com/v1/car-details-view/VT13561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f7b101-19c6-5147-9368-fdd5310df350 with identifier: KZ50055
2025-12-05 17:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f7b101-19c6-5147-9368-fdd5310df350 with scrape type 2
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6f7b101-19c6-5147-9368-fdd5310df350 with scrape type 2
2025-12-05 17:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a6f7b101-19c6-5147-9368-fdd5310df350, identifier: KZ50055
2025-12-05 17:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a6f7b101-19c6-5147-9368-fdd5310df350 with identifier: KZ50055
2025-12-05 17:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a6f7b101-19c6-5147-9368-fdd5310df350 with identifier: KZ50055
2025-12-05 17:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a6f7b101-19c6-5147-9368-fdd5310df350 with identifier: KZ50055 to the API
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ50055>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:05:11Z',
 'fuel_type': 'petrol',
 'id': 'a6f7b101-19c6-5147-9368-fdd5310df350',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ50055',
 'listing': 'auction',
 'location': 'ES, Elche',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 120749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2018}
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ50055%27 HTTP/1.1" 200 None
2025-12-05 17:02:17 [auto1.es] INFO: Saving data for KZ50055: {'auction_closing_time': 1765037111.0, 'created_time': 1764849717.466316, 'last_price_update_time': 1764954137.711343}
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ50055') HTTP/1.1" 204 0
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN12809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7c46af-c6ba-5f0a-b133-419217a6d3bd with identifier: VT13561
2025-12-05 17:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7c46af-c6ba-5f0a-b133-419217a6d3bd with scrape type 2
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7c46af-c6ba-5f0a-b133-419217a6d3bd with scrape type 2
2025-12-05 17:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e7c46af-c6ba-5f0a-b133-419217a6d3bd, identifier: VT13561
2025-12-05 17:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e7c46af-c6ba-5f0a-b133-419217a6d3bd with identifier: VT13561
2025-12-05 17:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e7c46af-c6ba-5f0a-b133-419217a6d3bd with identifier: VT13561
2025-12-05 17:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong musso grand 2.2 e-xdi crystal 4wd', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'musso grand', 'transmission': 'manual', 'odometer': 41007, 'odometer_reading_unit': 'km', 'registration_date': '2023-02-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt13561', 'expiration_date': '2025-12-06t16:52:23z', 'origin_country_code': 'es', 'trim': 'crystal 4wd', 'year': 2023, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 202, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '2.2l', 'location': 'es, caldes de malavella (girona)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 231, 'id': '4e7c46af-c6ba-5f0a-b133-419217a6d3bd', 'current_year_diff': 2, 'age_in_months': 33, 'make_model': 'ssangyong musso grand', 'sanitized_make': 'ssangyong', 'odometer_in_km': 41007}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 231,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '2.2l',
     'engine_horse_power': 202,
     'expiration_date': '2025-12-06t16:52:23z',
     'fuel_type': 'diesel',
     'id': '4e7c46af-c6ba-5f0a-b133-419217a6d3bd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt13561',
     'listing': 'auction',
     'location': 'es, caldes de malavella (girona)',
     'make': 'ssangyong',
     'make_model': 'ssangyong musso grand',
     'model': 'musso grand',
     'odometer': 41007,
     'odometer_in_km': 41007,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-02-12',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong musso grand 2.2 e-xdi crystal 4wd',
     'transmission': 'manual',
     'trim': 'crystal 4wd',
     'year': 2023}
2025-12-05 17:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 4e7c46af-c6ba-5f0a-b133-419217a6d3bd spider: auto1.es
2025-12-05 17:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4e7c46af-c6ba-5f0a-b133-419217a6d3bd due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong musso grand 2.2 e-xdi crystal 4wd', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'musso grand', 'transmission': 'manual', 'odometer': 41007, 'odometer_reading_unit': 'km', 'registration_date': '2023-02-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt13561', 'expiration_date': '2025-12-06t16:52:23z', 'origin_country_code': 'es', 'trim': 'crystal 4wd', 'year': 2023, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 202, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '2.2l', 'location': 'es, caldes de malavella (girona)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 231, 'id': '4e7c46af-c6ba-5f0a-b133-419217a6d3bd', 'current_year_diff': 2, 'age_in_months': 33, 'make_model': 'ssangyong musso grand', 'sanitized_make': 'ssangyong', 'odometer_in_km': 41007}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 231,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '2.2l',
     'engine_horse_power': 202,
     'expiration_date': '2025-12-06t16:52:23z',
     'fuel_type': 'diesel',
     'id': '4e7c46af-c6ba-5f0a-b133-419217a6d3bd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vt13561',
     'listing': 'auction',
     'location': 'es, caldes de malavella (girona)',
     'make': 'ssangyong',
     'make_model': 'ssangyong musso grand',
     'model': 'musso grand',
     'odometer': 41007,
     'odometer_in_km': 41007,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-02-12',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong musso grand 2.2 e-xdi crystal 4wd',
     'transmission': 'manual',
     'trim': 'crystal 4wd',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 202,
 'expiration_date': '2025-12-06T16:52:23Z',
 'fuel_type': 'diesel',
 'id': '4e7c46af-c6ba-5f0a-b133-419217a6d3bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT13561',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Ssangyong',
 'model': 'Musso Grand',
 'odometer': 41007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Musso Grand 2.2 e-Xdi Crystal 4WD',
 'transmission': 'manual',
 'trim': 'Crystal 4WD',
 'year': 2023}
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT13561%27 HTTP/1.1" 200 None
2025-12-05 17:02:18 [auto1.es] INFO: Saving data for VT13561: {'auction_closing_time': 1765039943.0, 'created_time': 1763971237.160577, 'last_price_update_time': 1764954138.021308}
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT13561') HTTP/1.1" 204 0
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ71374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK64256> (referer: https://www.auto1.com/v1/car-details-view/FK64256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW29974> (referer: https://www.auto1.com/v1/car-details-view/VW29974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0792abf-35b3-5ae3-a957-e2b21b067f28 with identifier: FK64256
2025-12-05 17:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0792abf-35b3-5ae3-a957-e2b21b067f28 with scrape type 2
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0792abf-35b3-5ae3-a957-e2b21b067f28 with scrape type 2
2025-12-05 17:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0792abf-35b3-5ae3-a957-e2b21b067f28, identifier: FK64256
2025-12-05 17:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0792abf-35b3-5ae3-a957-e2b21b067f28 with identifier: FK64256
2025-12-05 17:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0792abf-35b3-5ae3-a957-e2b21b067f28 with identifier: FK64256
2025-12-05 17:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2025-12-05 17:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f0792abf-35b3-5ae3-a957-e2b21b067f28 spider: auto1.es
2025-12-05 17:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f0792abf-35b3-5ae3-a957-e2b21b067f28 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:44:33Z',
 'fuel_type': 'diesel',
 'id': 'f0792abf-35b3-5ae3-a957-e2b21b067f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK64256',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 110728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2021}
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK64256%27 HTTP/1.1" 200 None
2025-12-05 17:02:18 [auto1.es] INFO: Saving data for FK64256: {'auction_closing_time': 1765039473.0, 'created_time': 1764849606.918393, 'last_price_update_time': 1764954138.430084}
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK64256') HTTP/1.1" 204 0
2025-12-05 17:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b694bda-d18b-53dc-b501-9725b9bead20 with identifier: VW29974
2025-12-05 17:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b694bda-d18b-53dc-b501-9725b9bead20 with scrape type 2
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b694bda-d18b-53dc-b501-9725b9bead20 with scrape type 2
2025-12-05 17:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b694bda-d18b-53dc-b501-9725b9bead20, identifier: VW29974
2025-12-05 17:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b694bda-d18b-53dc-b501-9725b9bead20 with identifier: VW29974
2025-12-05 17:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b694bda-d18b-53dc-b501-9725b9bead20 with identifier: VW29974
2025-12-05 17:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b694bda-d18b-53dc-b501-9725b9bead20 with identifier: VW29974 to the API
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW29974>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-06T16:10:31Z',
 'fuel_type': 'diesel',
 'id': '8b694bda-d18b-53dc-b501-9725b9bead20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW29974',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 121970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW29974%27 HTTP/1.1" 200 None
2025-12-05 17:02:19 [auto1.es] INFO: Saving data for VW29974: {'auction_closing_time': 1765037431.0, 'created_time': 1764349502.602493, 'last_price_update_time': 1764954139.030658}
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VW29974') HTTP/1.1" 204 0
2025-12-05 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH37532> (referer: https://www.auto1.com/v1/car-details-view/GH37532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD49691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ47642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF56643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532
2025-12-05 17:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b726524-3d95-5444-baf6-4b2789afa45e with scrape type 2
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b726524-3d95-5444-baf6-4b2789afa45e with scrape type 2
2025-12-05 17:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b726524-3d95-5444-baf6-4b2789afa45e, identifier: GH37532
2025-12-05 17:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532
2025-12-05 17:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532
2025-12-05 17:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532 to the API
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GH37532>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:56:36Z',
 'fuel_type': 'diesel',
 'id': '1b726524-3d95-5444-baf6-4b2789afa45e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH37532',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 75112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi C-Series',
 'transmission': 'manual',
 'trim': 'C-Series',
 'year': 2021}
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH37532%27 HTTP/1.1" 200 None
2025-12-05 17:02:19 [auto1.es] INFO: Saving data for GH37532: {'auction_closing_time': 1765040196.0, 'created_time': 1764850338.422533, 'last_price_update_time': 1764954139.688011}
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH37532') HTTP/1.1" 204 0
2025-12-05 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL33221> (referer: https://www.auto1.com/v1/car-details-view/CL33221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc96420-b2f8-5ccd-96ef-a13049cae5b0 with identifier: CL33221
2025-12-05 17:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc96420-b2f8-5ccd-96ef-a13049cae5b0 with scrape type 2
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc96420-b2f8-5ccd-96ef-a13049cae5b0 with scrape type 2
2025-12-05 17:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abc96420-b2f8-5ccd-96ef-a13049cae5b0, identifier: CL33221
2025-12-05 17:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abc96420-b2f8-5ccd-96ef-a13049cae5b0 with identifier: CL33221
2025-12-05 17:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abc96420-b2f8-5ccd-96ef-a13049cae5b0 with identifier: CL33221
2025-12-05 17:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abc96420-b2f8-5ccd-96ef-a13049cae5b0 with identifier: CL33221 to the API
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CL33221>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:01:51Z',
 'fuel_type': 'diesel',
 'id': 'abc96420-b2f8-5ccd-96ef-a13049cae5b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL33221',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 121431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL33221%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [auto1.es] INFO: Saving data for CL33221: {'auction_closing_time': 1765036911.0, 'created_time': 1764761964.426767, 'last_price_update_time': 1764954140.201894}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL33221') HTTP/1.1" 204 0
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB18960> (referer: https://www.auto1.com/v1/car-details-view/CB18960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU65780> (referer: https://www.auto1.com/v1/car-details-view/PU65780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0b89f43-0749-585e-a7b9-75c2a8cbde40 with identifier: CB18960
2025-12-05 17:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0b89f43-0749-585e-a7b9-75c2a8cbde40 with scrape type 2
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0b89f43-0749-585e-a7b9-75c2a8cbde40 with scrape type 2
2025-12-05 17:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0b89f43-0749-585e-a7b9-75c2a8cbde40, identifier: CB18960
2025-12-05 17:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0b89f43-0749-585e-a7b9-75c2a8cbde40 with identifier: CB18960
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0b89f43-0749-585e-a7b9-75c2a8cbde40 with identifier: CB18960
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193532 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193532
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c0b89f43-0749-585e-a7b9-75c2a8cbde40 spider: auto1.es
2025-12-05 17:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c0b89f43-0749-585e-a7b9-75c2a8cbde40 due to rule: high_mileage_for_country.json, error: 193532 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193532
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:27:42Z',
 'fuel_type': 'diesel',
 'id': 'c0b89f43-0749-585e-a7b9-75c2a8cbde40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB18960',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 193532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 30 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB18960%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [auto1.es] INFO: Saving data for CB18960: {'auction_closing_time': 1765038462.0, 'created_time': 1762329652.226623, 'last_price_update_time': 1764954140.610538}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CB18960') HTTP/1.1" 204 0
2025-12-05 17:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 with identifier: PU65780
2025-12-05 17:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 with scrape type 1
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_3e8188dc1c72ae44041568ca347bd350.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3e8188dc1c72ae44041568ca347bd350.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_25c81225da4527bade75c089bee8861c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_25c81225da4527bade75c089bee8861c.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_843ea6d35623d293c7ef05650ae14c7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_843ea6d35623d293c7ef05650ae14c7c.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_c076f81b07bb7449cc861a6ee95453d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c076f81b07bb7449cc861a6ee95453d7.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_8119a6741a185072234657b69d9fdb7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8119a6741a185072234657b69d9fdb7f.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_c08bec8dcdba472b1824beef74a06b78.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c08bec8dcdba472b1824beef74a06b78.jpg not downloaded yet
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS87361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_3a254eeddf6f662a57793152bcf857dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3a254eeddf6f662a57793152bcf857dc.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_2d525a986ef979557212471642a8e238.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_2d525a986ef979557212471642a8e238.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_0c6071fd0e0518023062f8aeb639b6ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0c6071fd0e0518023062f8aeb639b6ed.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_0d1a2086c4989eea55294b429916563f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0d1a2086c4989eea55294b429916563f.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_e2f814f9efad0eac6fc18f70891053c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_e2f814f9efad0eac6fc18f70891053c1.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_98e37737bbbbf4b77fff00baf2d24567.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_98e37737bbbbf4b77fff00baf2d24567.jpg not downloaded yet
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_b68ab548a1f08c010d76930a337639d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_b68ab548a1f08c010d76930a337639d3.jpg not downloaded yet
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM50635> (referer: https://www.auto1.com/v1/car-details-view/SM50635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_6adc1eb2641dd24f328d8543b6b01d8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_6adc1eb2641dd24f328d8543b6b01d8d.jpg not downloaded yet
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH22657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_f9d83df20f6f66b95fe65222e9abf201.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_f9d83df20f6f66b95fe65222e9abf201.jpg not downloaded yet
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_8034cba77c233c817c9f02bc520050c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8034cba77c233c817c9f02bc520050c9.jpg not downloaded yet
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW81522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d9a006e-5544-57e4-816e-e884a2dc6ebe with identifier: SM50635
2025-12-05 17:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9a006e-5544-57e4-816e-e884a2dc6ebe with scrape type 2
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d9a006e-5544-57e4-816e-e884a2dc6ebe with scrape type 2
2025-12-05 17:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d9a006e-5544-57e4-816e-e884a2dc6ebe, identifier: SM50635
2025-12-05 17:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d9a006e-5544-57e4-816e-e884a2dc6ebe with identifier: SM50635
2025-12-05 17:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d9a006e-5544-57e4-816e-e884a2dc6ebe with identifier: SM50635
2025-12-05 17:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d9a006e-5544-57e4-816e-e884a2dc6ebe with identifier: SM50635 to the API
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM50635>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:49:23Z',
 'fuel_type': 'petrol',
 'id': '6d9a006e-5544-57e4-816e-e884a2dc6ebe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM50635',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 132440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2020}
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM50635%27 HTTP/1.1" 200 None
2025-12-05 17:02:21 [auto1.es] INFO: Saving data for SM50635: {'auction_closing_time': 1765039763.0, 'created_time': 1764849740.776643, 'last_price_update_time': 1764954141.450324}
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM50635') HTTP/1.1" 204 0
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_b68ab548a1f08c010d76930a337639d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_6adc1eb2641dd24f328d8543b6b01d8d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8119a6741a185072234657b69d9fdb7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8034cba77c233c817c9f02bc520050c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP20815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH58137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fcc90>
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_b68ab548a1f08c010d76930a337639d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_b68ab548a1f08c010d76930a337639d3.jpg saved to cache
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_f9d83df20f6f66b95fe65222e9abf201.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_98e37737bbbbf4b77fff00baf2d24567.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0c6071fd0e0518023062f8aeb639b6ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_e2f814f9efad0eac6fc18f70891053c1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0d1a2086c4989eea55294b429916563f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6d44d0>
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_6adc1eb2641dd24f328d8543b6b01d8d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_6adc1eb2641dd24f328d8543b6b01d8d.jpg saved to cache
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c3b90>
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_8119a6741a185072234657b69d9fdb7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8119a6741a185072234657b69d9fdb7f.jpg saved to cache
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d859650>
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_8034cba77c233c817c9f02bc520050c9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8034cba77c233c817c9f02bc520050c9.jpg saved to cache
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP83905> (referer: https://www.auto1.com/v1/car-details-view/FP83905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC57851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN12809> (referer: https://www.auto1.com/v1/car-details-view/TN12809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da4cf90>
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_f9d83df20f6f66b95fe65222e9abf201.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_f9d83df20f6f66b95fe65222e9abf201.jpg saved to cache
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8ea090>
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_98e37737bbbbf4b77fff00baf2d24567.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_98e37737bbbbf4b77fff00baf2d24567.jpg saved to cache
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a3c10>
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_0c6071fd0e0518023062f8aeb639b6ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0c6071fd0e0518023062f8aeb639b6ed.jpg saved to cache
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac3b10>
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_e2f814f9efad0eac6fc18f70891053c1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_e2f814f9efad0eac6fc18f70891053c1.jpg saved to cache
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7c5050>
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_0d1a2086c4989eea55294b429916563f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0d1a2086c4989eea55294b429916563f.jpg saved to cache
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW12684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3a254eeddf6f662a57793152bcf857dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_2d525a986ef979557212471642a8e238.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c08bec8dcdba472b1824beef74a06b78.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ71374> (referer: https://www.auto1.com/v1/car-details-view/LJ71374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ23225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL02071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee29e17-5a11-50e7-b493-36c8602ae907 with identifier: FP83905
2025-12-05 17:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee29e17-5a11-50e7-b493-36c8602ae907 with scrape type 2
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cee29e17-5a11-50e7-b493-36c8602ae907 with scrape type 2
2025-12-05 17:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cee29e17-5a11-50e7-b493-36c8602ae907, identifier: FP83905
2025-12-05 17:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809
2025-12-05 17:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d8f779-bf4a-5575-8363-683f8344c053 with scrape type 2
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d8f779-bf4a-5575-8363-683f8344c053 with scrape type 2
2025-12-05 17:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2d8f779-bf4a-5575-8363-683f8344c053, identifier: TN12809
2025-12-05 17:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cee29e17-5a11-50e7-b493-36c8602ae907 with identifier: FP83905
2025-12-05 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cee29e17-5a11-50e7-b493-36c8602ae907 with identifier: FP83905
2025-12-05 17:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cee29e17-5a11-50e7-b493-36c8602ae907 with identifier: FP83905 to the API
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP83905>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2025-12-06T16:40:31Z',
 'fuel_type': 'petrol',
 'id': 'cee29e17-5a11-50e7-b493-36c8602ae907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP83905',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 74594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 SLE 2WD',
 'transmission': 'manual',
 'trim': 'SLE 2WD',
 'year': 2020}
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP83905%27 HTTP/1.1" 200 None
2025-12-05 17:02:24 [auto1.es] INFO: Saving data for FP83905: {'auction_closing_time': 1765039231.0, 'created_time': 1761757430.716459, 'last_price_update_time': 1764954144.330709}
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FP83905') HTTP/1.1" 204 0
2025-12-05 17:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809
2025-12-05 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809
2025-12-05 17:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809 to the API
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TN12809>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 204,
 'expiration_date': '2025-12-06T16:41:23Z',
 'fuel_type': 'petrol',
 'id': 'b2d8f779-bf4a-5575-8363-683f8344c053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN12809',
 'listing': 'auction',
 'location': 'ES, A Cañiza Pontevedra',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 76035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2019}
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN12809%27 HTTP/1.1" 200 None
2025-12-05 17:02:24 [auto1.es] INFO: Saving data for TN12809: {'auction_closing_time': 1765039283.0, 'created_time': 1761325335.710427, 'last_price_update_time': 1764954144.651316}
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TN12809') HTTP/1.1" 204 0
2025-12-05 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c076f81b07bb7449cc861a6ee95453d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3e8188dc1c72ae44041568ca347bd350.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_25c81225da4527bade75c089bee8861c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_843ea6d35623d293c7ef05650ae14c7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbef8d0>
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_3a254eeddf6f662a57793152bcf857dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3a254eeddf6f662a57793152bcf857dc.jpg saved to cache
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ce7d0>
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_2d525a986ef979557212471642a8e238.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_2d525a986ef979557212471642a8e238.jpg saved to cache
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6baf10>
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_c08bec8dcdba472b1824beef74a06b78.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c08bec8dcdba472b1824beef74a06b78.jpg saved to cache
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cdd767d-cb98-5283-8e03-6e79bca10ee2 with identifier: LJ71374
2025-12-05 17:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cdd767d-cb98-5283-8e03-6e79bca10ee2 with scrape type 2
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cdd767d-cb98-5283-8e03-6e79bca10ee2 with scrape type 2
2025-12-05 17:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2cdd767d-cb98-5283-8e03-6e79bca10ee2, identifier: LJ71374
2025-12-05 17:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2cdd767d-cb98-5283-8e03-6e79bca10ee2 with identifier: LJ71374
2025-12-05 17:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2cdd767d-cb98-5283-8e03-6e79bca10ee2 with identifier: LJ71374
2025-12-05 17:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2cdd767d-cb98-5283-8e03-6e79bca10ee2 with identifier: LJ71374 to the API
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ71374>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:55:30Z',
 'fuel_type': 'diesel',
 'id': '2cdd767d-cb98-5283-8e03-6e79bca10ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ71374',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 74411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ71374%27 HTTP/1.1" 200 None
2025-12-05 17:02:25 [auto1.es] INFO: Saving data for LJ71374: {'auction_closing_time': 1765040130.0, 'created_time': 1764867677.464994, 'last_price_update_time': 1764954145.868109}
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ71374') HTTP/1.1" 204 0
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a2110>
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_c076f81b07bb7449cc861a6ee95453d7.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c076f81b07bb7449cc861a6ee95453d7.jpg saved to cache
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669054b4d0>
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_3e8188dc1c72ae44041568ca347bd350.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3e8188dc1c72ae44041568ca347bd350.jpg saved to cache
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669054b4d0>
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_25c81225da4527bade75c089bee8861c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_25c81225da4527bade75c089bee8861c.jpg saved to cache
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e836290>
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F85%252Fe185029c1535b0b0ddc28df19f40c62a%252Fpa%252FPU65780_843ea6d35623d293c7ef05650ae14c7c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_843ea6d35623d293c7ef05650ae14c7c.jpg saved to cache
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299
2025-12-05 17:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dd46cf8-a43d-5068-8ea1-1e575ff6b299, skipping ID generation
2025-12-05 17:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 with scrape type 1
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 from tracking dictionaries
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 sending to next pipeline
2025-12-05 17:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5dd46cf8-a43d-5068-8ea1-1e575ff6b299, identifier: PU65780
2025-12-05 17:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD44553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 with identifier: PU65780
2025-12-05 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 with identifier: PU65780
2025-12-05 17:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5dd46cf8-a43d-5068-8ea1-1e575ff6b299 with identifier: PU65780 to the API
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_843ea6d35623d293c7ef05650ae14c7c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:33:52Z',
 'fuel_type': 'diesel',
 'id': '5dd46cf8-a43d-5068-8ea1-1e575ff6b299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU65780',
 'listing': 'auction',
 'location': 'ES, Zaragoza',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 108268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3e8188dc1c72ae44041568ca347bd350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_25c81225da4527bade75c089bee8861c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_843ea6d35623d293c7ef05650ae14c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c076f81b07bb7449cc861a6ee95453d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8119a6741a185072234657b69d9fdb7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_c08bec8dcdba472b1824beef74a06b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_3a254eeddf6f662a57793152bcf857dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_2d525a986ef979557212471642a8e238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0c6071fd0e0518023062f8aeb639b6ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_0d1a2086c4989eea55294b429916563f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_e2f814f9efad0eac6fc18f70891053c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_98e37737bbbbf4b77fff00baf2d24567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_b68ab548a1f08c010d76930a337639d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_6adc1eb2641dd24f328d8543b6b01d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_f9d83df20f6f66b95fe65222e9abf201.jpg',
             'Width': 442},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd46cf8-a43d-5068-8ea1-1e575ff6b299/5dd46cf8-a43d-5068-8ea1-1e575ff6b299_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/85/e185029c1535b0b0ddc28df19f40c62a/pa/PU65780_8034cba77c233c817c9f02bc520050c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2019}
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU65780%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [auto1.es] INFO: Saving data for PU65780: {'created_time': 1764954147.333518, 'last_price_update_time': 1764954147.333527, 'auction_closing_time': 1765038832.0}
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PU65780') HTTP/1.1" 204 0
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ47642> (referer: https://www.auto1.com/v1/car-details-view/JJ47642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH22657> (referer: https://www.auto1.com/v1/car-details-view/NH22657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH58137> (referer: https://www.auto1.com/v1/car-details-view/FH58137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS87361> (referer: https://www.auto1.com/v1/car-details-view/FS87361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW81522> (referer: https://www.auto1.com/v1/car-details-view/MW81522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF56643> (referer: https://www.auto1.com/v1/car-details-view/WF56643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP20815> (referer: https://www.auto1.com/v1/car-details-view/HP20815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9 with identifier: JJ47642
2025-12-05 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9 with scrape type 2
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9 with scrape type 2
2025-12-05 17:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9, identifier: JJ47642
2025-12-05 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a26d2a5-2bba-5aef-a1c4-71915fe6378b with identifier: NH22657
2025-12-05 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a26d2a5-2bba-5aef-a1c4-71915fe6378b with scrape type 2
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a26d2a5-2bba-5aef-a1c4-71915fe6378b with scrape type 2
2025-12-05 17:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7a26d2a5-2bba-5aef-a1c4-71915fe6378b, identifier: NH22657
2025-12-05 17:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9 with identifier: JJ47642
2025-12-05 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9 with identifier: JJ47642
2025-12-05 17:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9 with identifier: JJ47642 to the API
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JJ47642>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:31:45Z',
 'fuel_type': 'diesel',
 'id': '0fa172e7-dc2b-5a40-9db6-48e6dfc4aca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ47642',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 122610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ47642%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [auto1.es] INFO: Saving data for JJ47642: {'auction_closing_time': 1765038705.0, 'created_time': 1763658103.894518, 'last_price_update_time': 1764954147.963636}
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JJ47642') HTTP/1.1" 204 0
2025-12-05 17:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7a26d2a5-2bba-5aef-a1c4-71915fe6378b with identifier: NH22657
2025-12-05 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7a26d2a5-2bba-5aef-a1c4-71915fe6378b with identifier: NH22657
2025-12-05 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169177 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169177
2025-12-05 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7a26d2a5-2bba-5aef-a1c4-71915fe6378b spider: auto1.es
2025-12-05 17:02:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7a26d2a5-2bba-5aef-a1c4-71915fe6378b due to rule: high_mileage_for_country.json, error: 169177 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169177
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:48:09Z',
 'fuel_type': 'diesel',
 'id': '7a26d2a5-2bba-5aef-a1c4-71915fe6378b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH22657',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 169177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH22657%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [auto1.es] INFO: Saving data for NH22657: {'auction_closing_time': 1765039689.0, 'created_time': 1764672149.018032, 'last_price_update_time': 1764954148.184943}
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NH22657') HTTP/1.1" 204 0
2025-12-05 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1117442-4c90-58ae-b5b5-caf712d7816c with identifier: FH58137
2025-12-05 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1117442-4c90-58ae-b5b5-caf712d7816c with scrape type 2
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1117442-4c90-58ae-b5b5-caf712d7816c with scrape type 2
2025-12-05 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1117442-4c90-58ae-b5b5-caf712d7816c, identifier: FH58137
2025-12-05 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 with identifier: FS87361
2025-12-05 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 with scrape type 1
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_6d3559264330f7fbeede947dfd80cbe5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_6d3559264330f7fbeede947dfd80cbe5.jpg not downloaded yet
2025-12-05 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2253961c-f493-5eef-bd96-da7bcc31b24d with identifier: MW81522
2025-12-05 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2253961c-f493-5eef-bd96-da7bcc31b24d with scrape type 2
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2253961c-f493-5eef-bd96-da7bcc31b24d with scrape type 2
2025-12-05 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2253961c-f493-5eef-bd96-da7bcc31b24d, identifier: MW81522
2025-12-05 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 with identifier: WF56643
2025-12-05 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 with scrape type 2
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 with scrape type 2
2025-12-05 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ddd0d6ff-7a6e-5b29-a799-4c44d7aea888, identifier: WF56643
2025-12-05 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 with identifier: HP20815
2025-12-05 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 with scrape type 1
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg not downloaded yet
2025-12-05 17:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1117442-4c90-58ae-b5b5-caf712d7816c with identifier: FH58137
2025-12-05 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1117442-4c90-58ae-b5b5-caf712d7816c with identifier: FH58137
2025-12-05 17:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1117442-4c90-58ae-b5b5-caf712d7816c with identifier: FH58137 to the API
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FH58137>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:06:18Z',
 'fuel_type': 'diesel',
 'id': 'c1117442-4c90-58ae-b5b5-caf712d7816c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH58137',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'BMW',
 'model': '1er',
 'odometer': 36112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH58137%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [auto1.es] INFO: Saving data for FH58137: {'auction_closing_time': 1765037178.0, 'created_time': 1763658096.102667, 'last_price_update_time': 1764954148.894026}
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH58137') HTTP/1.1" 204 0
2025-12-05 17:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2253961c-f493-5eef-bd96-da7bcc31b24d with identifier: MW81522
2025-12-05 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2253961c-f493-5eef-bd96-da7bcc31b24d with identifier: MW81522
2025-12-05 17:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2253961c-f493-5eef-bd96-da7bcc31b24d with identifier: MW81522 to the API
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW81522>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:32:07Z',
 'fuel_type': 'petrol',
 'id': '2253961c-f493-5eef-bd96-da7bcc31b24d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW81522',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 15918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW81522%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [auto1.es] INFO: Saving data for MW81522: {'auction_closing_time': 1765038727.0, 'created_time': 1763461088.252241, 'last_price_update_time': 1764954149.20853}
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW81522') HTTP/1.1" 204 0
2025-12-05 17:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 with identifier: WF56643
2025-12-05 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 with identifier: WF56643
2025-12-05 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159520 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159520
2025-12-05 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 spider: auto1.es
2025-12-05 17:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ddd0d6ff-7a6e-5b29-a799-4c44d7aea888 due to rule: high_mileage_for_country.json, error: 159520 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159520
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:32:33Z',
 'fuel_type': 'diesel',
 'id': 'ddd0d6ff-7a6e-5b29-a799-4c44d7aea888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF56643',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 159520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF56643%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [auto1.es] INFO: Saving data for WF56643: {'auction_closing_time': 1765038753.0, 'created_time': 1764850128.728874, 'last_price_update_time': 1764954149.437075}
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WF56643') HTTP/1.1" 204 0
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_faf0c47d7885df1fd62507ebdc71ee76.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_faf0c47d7885df1fd62507ebdc71ee76.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_51df784c73c3019aa22c635909f741e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_51df784c73c3019aa22c635909f741e1.jpg not downloaded yet
2025-12-05 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD49691> (referer: https://www.auto1.com/v1/car-details-view/YD49691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_7311216e7880bce8b59cf927721cb2fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7311216e7880bce8b59cf927721cb2fc.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_6e5ac13c7d6ae540220e08ec50e595ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_6e5ac13c7d6ae540220e08ec50e595ca.jpg not downloaded yet
2025-12-05 17:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_cacdee426eca6e2f82275a37a895bd57.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_cacdee426eca6e2f82275a37a895bd57.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_f90f9bca0031d2c15d6c7b7797ccbf19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f90f9bca0031d2c15d6c7b7797ccbf19.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_3e6112db47447dd3a5eb90d5d4d74583.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e6112db47447dd3a5eb90d5d4d74583.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_4d67f0c52cee819d70bf0daddbf65477.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_4d67f0c52cee819d70bf0daddbf65477.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_a4990bd29cfed911e248116449bab938.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_a4990bd29cfed911e248116449bab938.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_9314dc0c746b1835de95b22f6f442f56.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9314dc0c746b1835de95b22f6f442f56.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_7a64c1fc43d69b6a45ce4313ddea0799.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7a64c1fc43d69b6a45ce4313ddea0799.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_bf0558d54dc20e7e505d2a6a2500ccf3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_bf0558d54dc20e7e505d2a6a2500ccf3.jpg not downloaded yet
2025-12-05 17:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 with identifier: YD49691
2025-12-05 17:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 with scrape type 2
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 with scrape type 2
2025-12-05 17:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6, identifier: YD49691
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_e6dc27d2da2bd4c3caa8029d270f27b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_e6dc27d2da2bd4c3caa8029d270f27b7.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_dfcc493c6f61c8e92ce91e75ead5a93e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_dfcc493c6f61c8e92ce91e75ead5a93e.jpg not downloaded yet
2025-12-05 17:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 with identifier: YD49691
2025-12-05 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 with identifier: YD49691
2025-12-05 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 spider: auto1.es
2025-12-05 17:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:49:58Z',
 'fuel_type': 'diesel',
 'id': 'dde5e43e-8aa4-54b8-a4f0-1d1e10f5a9c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD49691',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 83883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Life Pack M',
 'transmission': 'manual',
 'trim': 'Life Pack M',
 'year': 2022}
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD49691%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [auto1.es] INFO: Saving data for YD49691: {'auction_closing_time': 1765039798.0, 'created_time': 1762840856.79471, 'last_price_update_time': 1764954150.009861}
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YD49691') HTTP/1.1" 204 0
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_51df784c73c3019aa22c635909f741e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_35736cdbd4c11d76cff842c1631fd658.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_35736cdbd4c11d76cff842c1631fd658.jpg not downloaded yet
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_56ff301752ddf85da6da0d06730e9b3d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_56ff301752ddf85da6da0d06730e9b3d.jpg not downloaded yet
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE13823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH71746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_998cbc110f4f385ed7390083c6f47949.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_998cbc110f4f385ed7390083c6f47949.jpg not downloaded yet
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_20512ad20407296ebd9ff0ec5fa66c1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_20512ad20407296ebd9ff0ec5fa66c1e.jpg not downloaded yet
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL98891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_db4368fcbf834356a4e613053fd415c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_db4368fcbf834356a4e613053fd415c7.jpg not downloaded yet
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_d60760d059cf71c381f5d6ae7e7d6894.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_d60760d059cf71c381f5d6ae7e7d6894.jpg not downloaded yet
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY20258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_2060e45243eede21a090d05935cc7fb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_2060e45243eede21a090d05935cc7fb0.jpg not downloaded yet
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_161bb2b5c3b6e649b39072f268c30f0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_161bb2b5c3b6e649b39072f268c30f0a.jpg not downloaded yet
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN61769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe3c10>
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_51df784c73c3019aa22c635909f741e1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_51df784c73c3019aa22c635909f741e1.jpg saved to cache
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_bf0558d54dc20e7e505d2a6a2500ccf3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_174f49767efae1c05ebc80259f25123a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_174f49767efae1c05ebc80259f25123a.jpg not downloaded yet
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_f060360af2d32733320df291d27c6fe4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f060360af2d32733320df291d27c6fe4.jpg not downloaded yet
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_56ff301752ddf85da6da0d06730e9b3d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_20512ad20407296ebd9ff0ec5fa66c1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_35736cdbd4c11d76cff842c1631fd658.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_3e0276c7731d67d1443a160504800d8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e0276c7731d67d1443a160504800d8c.jpg not downloaded yet
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_8e55967475e5ead3b0238301f0b5d18c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_8e55967475e5ead3b0238301f0b5d18c.jpg not downloaded yet
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX67476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC57851> (referer: https://www.auto1.com/v1/car-details-view/UC57851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_e057a8e4b4ac6dd6ff49a0ee9afface1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_e057a8e4b4ac6dd6ff49a0ee9afface1.jpg not downloaded yet
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_d60760d059cf71c381f5d6ae7e7d6894.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_2060e45243eede21a090d05935cc7fb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_9b1f634360637bda763ec85580c38749.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9b1f634360637bda763ec85580c38749.jpg not downloaded yet
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e676750>
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_bf0558d54dc20e7e505d2a6a2500ccf3.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_bf0558d54dc20e7e505d2a6a2500ccf3.jpg saved to cache
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfe4d0>
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_56ff301752ddf85da6da0d06730e9b3d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_56ff301752ddf85da6da0d06730e9b3d.jpg saved to cache
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e723610>
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_20512ad20407296ebd9ff0ec5fa66c1e.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_20512ad20407296ebd9ff0ec5fa66c1e.jpg saved to cache
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e723510>
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_35736cdbd4c11d76cff842c1631fd658.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_35736cdbd4c11d76cff842c1631fd658.jpg saved to cache
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_998cbc110f4f385ed7390083c6f47949.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_db4368fcbf834356a4e613053fd415c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_161bb2b5c3b6e649b39072f268c30f0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_dfcc493c6f61c8e92ce91e75ead5a93e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_8e55967475e5ead3b0238301f0b5d18c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e0276c7731d67d1443a160504800d8c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV28975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ23225> (referer: https://www.auto1.com/v1/car-details-view/CZ23225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW12684> (referer: https://www.auto1.com/v1/car-details-view/CW12684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL02071> (referer: https://www.auto1.com/v1/car-details-view/BL02071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e7974a-8c41-57f2-80e3-f7ab51357438 with identifier: UC57851
2025-12-05 17:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e7974a-8c41-57f2-80e3-f7ab51357438 with scrape type 1
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_74f8780b10a9e3183ab125f8ace018af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_74f8780b10a9e3183ab125f8ace018af.jpg not downloaded yet
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e1bd0>
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_d60760d059cf71c381f5d6ae7e7d6894.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_d60760d059cf71c381f5d6ae7e7d6894.jpg saved to cache
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc2410>
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_2060e45243eede21a090d05935cc7fb0.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_2060e45243eede21a090d05935cc7fb0.jpg saved to cache
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_d0881e57156c1bc74905ba20f8ab8c9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_d0881e57156c1bc74905ba20f8ab8c9b.jpg not downloaded yet
2025-12-05 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_e057a8e4b4ac6dd6ff49a0ee9afface1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_f3647e38af225696442f2ab97524e3e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_f3647e38af225696442f2ab97524e3e0.jpg not downloaded yet
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8eab90>
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_998cbc110f4f385ed7390083c6f47949.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_998cbc110f4f385ed7390083c6f47949.jpg saved to cache
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbccd90>
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_db4368fcbf834356a4e613053fd415c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_db4368fcbf834356a4e613053fd415c7.jpg saved to cache
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da82c10>
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_161bb2b5c3b6e649b39072f268c30f0a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_161bb2b5c3b6e649b39072f268c30f0a.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e584d10>
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_dfcc493c6f61c8e92ce91e75ead5a93e.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_dfcc493c6f61c8e92ce91e75ead5a93e.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d957950>
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_8e55967475e5ead3b0238301f0b5d18c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_8e55967475e5ead3b0238301f0b5d18c.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbced90>
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_3e0276c7731d67d1443a160504800d8c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e0276c7731d67d1443a160504800d8c.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb3f6ed-2abf-5a24-86a3-507634d2b019 with identifier: CZ23225
2025-12-05 17:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019 with scrape type 1
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_48349d2445818ee1f4a2994ada2c0881.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_48349d2445818ee1f4a2994ada2c0881.jpg not downloaded yet
2025-12-05 17:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254d227b-8dc8-5ba3-8d84-0f4ff79dba37 with identifier: CW12684
2025-12-05 17:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254d227b-8dc8-5ba3-8d84-0f4ff79dba37 with scrape type 2
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 254d227b-8dc8-5ba3-8d84-0f4ff79dba37 with scrape type 2
2025-12-05 17:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 254d227b-8dc8-5ba3-8d84-0f4ff79dba37, identifier: CW12684
2025-12-05 17:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee with identifier: BL02071
2025-12-05 17:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee with scrape type 1
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_68647061a362cc8405482ac09161ece5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_68647061a362cc8405482ac09161ece5.jpg not downloaded yet
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ49177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 254d227b-8dc8-5ba3-8d84-0f4ff79dba37 with identifier: CW12684
2025-12-05 17:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 254d227b-8dc8-5ba3-8d84-0f4ff79dba37 with identifier: CW12684
2025-12-05 17:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 254d227b-8dc8-5ba3-8d84-0f4ff79dba37 with identifier: CW12684 to the API
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW12684>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-06T16:52:10Z',
 'fuel_type': 'petrol',
 'id': '254d227b-8dc8-5ba3-8d84-0f4ff79dba37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW12684',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 107455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW12684%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [auto1.es] INFO: Saving data for CW12684: {'auction_closing_time': 1765039930.0, 'created_time': 1763485428.357268, 'last_price_update_time': 1764954154.535322}
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CW12684') HTTP/1.1" 204 0
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f060360af2d32733320df291d27c6fe4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_74f8780b10a9e3183ab125f8ace018af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_174f49767efae1c05ebc80259f25123a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_e6dc27d2da2bd4c3caa8029d270f27b7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_8cac07f45412c29fbdcc8878a07a9551.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_8cac07f45412c29fbdcc8878a07a9551.jpg not downloaded yet
2025-12-05 17:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_c3542fa31eeb8b08b65a730a1a49a192.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c3542fa31eeb8b08b65a730a1a49a192.jpg not downloaded yet
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_6b107c04c5fa30dd66ad403315c06ebe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_6b107c04c5fa30dd66ad403315c06ebe.jpg not downloaded yet
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC72590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF92414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9b1f634360637bda763ec85580c38749.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH24581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e589750>
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_e057a8e4b4ac6dd6ff49a0ee9afface1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_e057a8e4b4ac6dd6ff49a0ee9afface1.jpg saved to cache
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7a64c1fc43d69b6a45ce4313ddea0799.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_39e2251ee831db0457aaa21b298c5522.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_39e2251ee831db0457aaa21b298c5522.jpg not downloaded yet
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_d6f4fe2c269d4a1b0af3206f3a8dad37.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d6f4fe2c269d4a1b0af3206f3a8dad37.jpg not downloaded yet
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_973390c5be152169893273ad064726e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_973390c5be152169893273ad064726e8.jpg not downloaded yet
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_1347364c488804d39adf32955954cb31.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_1347364c488804d39adf32955954cb31.jpg not downloaded yet
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_29a7a001e73b5236db6edf76ada5b499.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_29a7a001e73b5236db6edf76ada5b499.jpg not downloaded yet
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_0df06c33e6db4362cabcef77b48ba57b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_0df06c33e6db4362cabcef77b48ba57b.jpg not downloaded yet
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d955f50>
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_f060360af2d32733320df291d27c6fe4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f060360af2d32733320df291d27c6fe4.jpg saved to cache
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e576150>
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_74f8780b10a9e3183ab125f8ace018af.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_74f8780b10a9e3183ab125f8ace018af.jpg saved to cache
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcd010>
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_174f49767efae1c05ebc80259f25123a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_174f49767efae1c05ebc80259f25123a.jpg saved to cache
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e459410>
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_e6dc27d2da2bd4c3caa8029d270f27b7.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_e6dc27d2da2bd4c3caa8029d270f27b7.jpg saved to cache
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e45a090>
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_9b1f634360637bda763ec85580c38749.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9b1f634360637bda763ec85580c38749.jpg saved to cache
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_68647061a362cc8405482ac09161ece5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_48349d2445818ee1f4a2994ada2c0881.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_4d67f0c52cee819d70bf0daddbf65477.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9314dc0c746b1835de95b22f6f442f56.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_3dd4397bc3a6ce678733aa497ccc7297.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_3dd4397bc3a6ce678733aa497ccc7297.jpg not downloaded yet
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_b7cdbf42165dd8cba9d3998375094e33.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_b7cdbf42165dd8cba9d3998375094e33.jpg not downloaded yet
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_4eb5d8379b10500b5a4afdc44e75dbf3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_4eb5d8379b10500b5a4afdc44e75dbf3.jpg not downloaded yet
2025-12-05 17:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_a4990bd29cfed911e248116449bab938.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_6b107c04c5fa30dd66ad403315c06ebe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_f3647e38af225696442f2ab97524e3e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_d0881e57156c1bc74905ba20f8ab8c9b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_e5a686d384745248512af357d6c2d69f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_e5a686d384745248512af357d6c2d69f.jpg not downloaded yet
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_c8590aecb7a2f98e3c53c16e62f7cd08.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c8590aecb7a2f98e3c53c16e62f7cd08.jpg not downloaded yet
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_ce18e2a18cbd11ef04153d826a8c0137.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_ce18e2a18cbd11ef04153d826a8c0137.jpg not downloaded yet
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9e51d0>
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_7a64c1fc43d69b6a45ce4313ddea0799.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7a64c1fc43d69b6a45ce4313ddea0799.jpg saved to cache
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_0df06c33e6db4362cabcef77b48ba57b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_77c44add185c44a67882b6d4e0b369ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_77c44add185c44a67882b6d4e0b369ac.jpg not downloaded yet
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_1cae56ac854eb576584cf6b3189470fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_1cae56ac854eb576584cf6b3189470fa.jpg not downloaded yet
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_02909069cc50ed03151274b2a7354f31.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_02909069cc50ed03151274b2a7354f31.jpg not downloaded yet
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c3542fa31eeb8b08b65a730a1a49a192.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e585450>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_68647061a362cc8405482ac09161ece5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_68647061a362cc8405482ac09161ece5.jpg saved to cache
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e635b10>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_48349d2445818ee1f4a2994ada2c0881.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_48349d2445818ee1f4a2994ada2c0881.jpg saved to cache
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a5290>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_4d67f0c52cee819d70bf0daddbf65477.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_4d67f0c52cee819d70bf0daddbf65477.jpg saved to cache
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d99b550>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_9314dc0c746b1835de95b22f6f442f56.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9314dc0c746b1835de95b22f6f442f56.jpg saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74dc50>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_a4990bd29cfed911e248116449bab938.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_a4990bd29cfed911e248116449bab938.jpg saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db768d0>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_6b107c04c5fa30dd66ad403315c06ebe.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_6b107c04c5fa30dd66ad403315c06ebe.jpg saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8bdb10>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_f3647e38af225696442f2ab97524e3e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_f3647e38af225696442f2ab97524e3e0.jpg saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e57d7d0>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_d0881e57156c1bc74905ba20f8ab8c9b.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_d0881e57156c1bc74905ba20f8ab8c9b.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_0943376d39a36e55ee45cd6b4e0380fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_0943376d39a36e55ee45cd6b4e0380fc.jpg not downloaded yet
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_8640077523ad871942eb7786aa7bdbff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_8640077523ad871942eb7786aa7bdbff.jpg not downloaded yet
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_9b9e13de65a10e1cee774d0ba35dff8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_9b9e13de65a10e1cee774d0ba35dff8f.jpg not downloaded yet
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_29a7a001e73b5236db6edf76ada5b499.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_973390c5be152169893273ad064726e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_1347364c488804d39adf32955954cb31.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_42a5caae8f57ab28ee4f5c3d03d8e3e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_42a5caae8f57ab28ee4f5c3d03d8e3e2.jpg not downloaded yet
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_584c723ee169754d44ef79eab6d4d49c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_584c723ee169754d44ef79eab6d4d49c.jpg not downloaded yet
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_b920bb3a807517a9c540922198875f2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_b920bb3a807517a9c540922198875f2f.jpg not downloaded yet
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX67476> (referer: https://www.auto1.com/v1/car-details-view/DX67476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY20258> (referer: https://www.auto1.com/v1/car-details-view/DY20258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL98891> (referer: https://www.auto1.com/v1/car-details-view/HL98891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV28975> (referer: https://www.auto1.com/v1/car-details-view/FV28975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN61769> (referer: https://www.auto1.com/v1/car-details-view/TN61769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH71746> (referer: https://www.auto1.com/v1/car-details-view/LH71746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE13823> (referer: https://www.auto1.com/v1/car-details-view/XE13823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d890c50>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_0df06c33e6db4362cabcef77b48ba57b.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_0df06c33e6db4362cabcef77b48ba57b.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d999750>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_c3542fa31eeb8b08b65a730a1a49a192.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c3542fa31eeb8b08b65a730a1a49a192.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_57bb47c62c50d1476bc4eea0802780ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_57bb47c62c50d1476bc4eea0802780ba.jpg not downloaded yet
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e5dd70cb8ead5dff135031f366f93f93.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e5dd70cb8ead5dff135031f366f93f93.jpg not downloaded yet
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_8519b00d0d00225450cf3f52a4b74a7a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_8519b00d0d00225450cf3f52a4b74a7a.jpg not downloaded yet
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_ce18e2a18cbd11ef04153d826a8c0137.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c8590aecb7a2f98e3c53c16e62f7cd08.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d899310>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_29a7a001e73b5236db6edf76ada5b499.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_29a7a001e73b5236db6edf76ada5b499.jpg saved to cache
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da956d0>
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_973390c5be152169893273ad064726e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_973390c5be152169893273ad064726e8.jpg saved to cache
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e825e50>
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_1347364c488804d39adf32955954cb31.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_1347364c488804d39adf32955954cb31.jpg saved to cache
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c83e09-9164-5d31-a819-1fe89daf7014 with identifier: DX67476
2025-12-05 17:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c83e09-9164-5d31-a819-1fe89daf7014 with scrape type 2
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1c83e09-9164-5d31-a819-1fe89daf7014 with scrape type 2
2025-12-05 17:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1c83e09-9164-5d31-a819-1fe89daf7014, identifier: DX67476
2025-12-05 17:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ac253e-7c30-510b-b566-67b1a6b95b26 with identifier: DY20258
2025-12-05 17:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ac253e-7c30-510b-b566-67b1a6b95b26 with scrape type 2
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ac253e-7c30-510b-b566-67b1a6b95b26 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7ac253e-7c30-510b-b566-67b1a6b95b26, identifier: DY20258
2025-12-05 17:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b18c470-7ed8-5c89-a3cd-775079cc95d5 with identifier: HL98891
2025-12-05 17:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b18c470-7ed8-5c89-a3cd-775079cc95d5 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b18c470-7ed8-5c89-a3cd-775079cc95d5 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b18c470-7ed8-5c89-a3cd-775079cc95d5, identifier: HL98891
2025-12-05 17:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a62f7051-f22b-5042-94c3-1f0fc9b3cb7d with identifier: FV28975
2025-12-05 17:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62f7051-f22b-5042-94c3-1f0fc9b3cb7d with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a62f7051-f22b-5042-94c3-1f0fc9b3cb7d with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a62f7051-f22b-5042-94c3-1f0fc9b3cb7d, identifier: FV28975
2025-12-05 17:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d4646df-d265-523f-b271-5e2a5013487e with identifier: TN61769
2025-12-05 17:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4646df-d265-523f-b271-5e2a5013487e with scrape type 1
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_80abc32ddd4635518a10b314317d4ae8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_80abc32ddd4635518a10b314317d4ae8.jpg not downloaded yet
2025-12-05 17:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c50eaa5-cee0-5e0a-a653-c3eef3825e86 with identifier: LH71746
2025-12-05 17:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c50eaa5-cee0-5e0a-a653-c3eef3825e86 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c50eaa5-cee0-5e0a-a653-c3eef3825e86 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c50eaa5-cee0-5e0a-a653-c3eef3825e86, identifier: LH71746
2025-12-05 17:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22818eb6-f8e9-5afc-b04a-2230b5427249 with identifier: XE13823
2025-12-05 17:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22818eb6-f8e9-5afc-b04a-2230b5427249 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22818eb6-f8e9-5afc-b04a-2230b5427249 with scrape type 2
2025-12-05 17:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22818eb6-f8e9-5afc-b04a-2230b5427249, identifier: XE13823
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_72f570b75d723752a77e316c0896dc0e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_72f570b75d723752a77e316c0896dc0e.jpg not downloaded yet
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e11c73c201c1ae54640ca3c39933bd3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e11c73c201c1ae54640ca3c39933bd3a.jpg not downloaded yet
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_7a5efd2c518535d2e4a47d0995caf2db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7a5efd2c518535d2e4a47d0995caf2db.jpg not downloaded yet
2025-12-05 17:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1c83e09-9164-5d31-a819-1fe89daf7014 with identifier: DX67476
2025-12-05 17:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1c83e09-9164-5d31-a819-1fe89daf7014 with identifier: DX67476
2025-12-05 17:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1c83e09-9164-5d31-a819-1fe89daf7014 with identifier: DX67476 to the API
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX67476>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 272,
 'expiration_date': '2025-12-06T16:26:47Z',
 'fuel_type': 'petrol',
 'id': 'd1c83e09-9164-5d31-a819-1fe89daf7014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX67476',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 50008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP GTi',
 'transmission': 'manual',
 'trim': 'GTi',
 'year': 2016}
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX67476%27 HTTP/1.1" 200 None
2025-12-05 17:02:41 [auto1.es] INFO: Saving data for DX67476: {'auction_closing_time': 1765038407.0, 'created_time': 1764176801.858511, 'last_price_update_time': 1764954161.826577}
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX67476') HTTP/1.1" 204 0
2025-12-05 17:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7ac253e-7c30-510b-b566-67b1a6b95b26 with identifier: DY20258
2025-12-05 17:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7ac253e-7c30-510b-b566-67b1a6b95b26 with identifier: DY20258
2025-12-05 17:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7ac253e-7c30-510b-b566-67b1a6b95b26 with identifier: DY20258 to the API
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY20258>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:56:09Z',
 'fuel_type': 'petrol',
 'id': 'd7ac253e-7c30-510b-b566-67b1a6b95b26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY20258',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 85629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY20258%27 HTTP/1.1" 200 None
2025-12-05 17:02:42 [auto1.es] INFO: Saving data for DY20258: {'auction_closing_time': 1765040169.0, 'created_time': 1764762337.996657, 'last_price_update_time': 1764954162.448512}
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DY20258') HTTP/1.1" 204 0
2025-12-05 17:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b18c470-7ed8-5c89-a3cd-775079cc95d5 with identifier: HL98891
2025-12-05 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b18c470-7ed8-5c89-a3cd-775079cc95d5 with identifier: HL98891
2025-12-05 17:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b18c470-7ed8-5c89-a3cd-775079cc95d5 with identifier: HL98891 to the API
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL98891>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:31:34Z',
 'fuel_type': 'gas',
 'id': '1b18c470-7ed8-5c89-a3cd-775079cc95d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL98891',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 99858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TGI FR Edition',
 'transmission': 'manual',
 'trim': 'FR Edition',
 'year': 2021}
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL98891%27 HTTP/1.1" 200 None
2025-12-05 17:02:42 [auto1.es] INFO: Saving data for HL98891: {'auction_closing_time': 1765038694.0, 'created_time': 1764761847.01973, 'last_price_update_time': 1764954162.757108}
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL98891') HTTP/1.1" 204 0
2025-12-05 17:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a62f7051-f22b-5042-94c3-1f0fc9b3cb7d with identifier: FV28975
2025-12-05 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a62f7051-f22b-5042-94c3-1f0fc9b3cb7d with identifier: FV28975
2025-12-05 17:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a62f7051-f22b-5042-94c3-1f0fc9b3cb7d with identifier: FV28975 to the API
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV28975>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:19:13Z',
 'fuel_type': 'diesel',
 'id': 'a62f7051-f22b-5042-94c3-1f0fc9b3cb7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV28975',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 4732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV28975%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [auto1.es] INFO: Saving data for FV28975: {'auction_closing_time': 1765037953.0, 'created_time': 1764176560.018766, 'last_price_update_time': 1764954163.057779}
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV28975') HTTP/1.1" 204 0
2025-12-05 17:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c50eaa5-cee0-5e0a-a653-c3eef3825e86 with identifier: LH71746
2025-12-05 17:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c50eaa5-cee0-5e0a-a653-c3eef3825e86 with identifier: LH71746
2025-12-05 17:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c50eaa5-cee0-5e0a-a653-c3eef3825e86 with identifier: LH71746 to the API
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LH71746>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:31:38Z',
 'fuel_type': 'petrol',
 'id': '4c50eaa5-cee0-5e0a-a653-c3eef3825e86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH71746',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 131898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH71746%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [auto1.es] INFO: Saving data for LH71746: {'auction_closing_time': 1765038698.0, 'created_time': 1764850907.842485, 'last_price_update_time': 1764954163.3728}
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH71746') HTTP/1.1" 204 0
2025-12-05 17:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22818eb6-f8e9-5afc-b04a-2230b5427249 with identifier: XE13823
2025-12-05 17:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22818eb6-f8e9-5afc-b04a-2230b5427249 with identifier: XE13823
2025-12-05 17:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 22818eb6-f8e9-5afc-b04a-2230b5427249 with identifier: XE13823 to the API
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE13823>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:54:25Z',
 'fuel_type': 'diesel',
 'id': '22818eb6-f8e9-5afc-b04a-2230b5427249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE13823',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 100110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2019}
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE13823%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [auto1.es] INFO: Saving data for XE13823: {'auction_closing_time': 1765040065.0, 'created_time': 1764761800.508066, 'last_price_update_time': 1764954163.684707}
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XE13823') HTTP/1.1" 204 0
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_9b9e13de65a10e1cee774d0ba35dff8f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_1bec3d678408c410a31288e87ff34919.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_1bec3d678408c410a31288e87ff34919.jpg not downloaded yet
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_02909069cc50ed03151274b2a7354f31.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_1cae56ac854eb576584cf6b3189470fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_8640077523ad871942eb7786aa7bdbff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_77c44add185c44a67882b6d4e0b369ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_0943376d39a36e55ee45cd6b4e0380fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_27e2f2f92f48aa38f25d831a7e3958db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_27e2f2f92f48aa38f25d831a7e3958db.jpg not downloaded yet
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_d4f3b10a6485c6958ffcfd9a2a464a96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d4f3b10a6485c6958ffcfd9a2a464a96.jpg not downloaded yet
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_e3fc77d6aad34148e5f22a048abe4894.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_e3fc77d6aad34148e5f22a048abe4894.jpg not downloaded yet
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH24581> (referer: https://www.auto1.com/v1/car-details-view/XH24581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_4eb5d8379b10500b5a4afdc44e75dbf3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_e5a686d384745248512af357d6c2d69f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_9d11383e1fe6417c48f7646f71b9b918.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_9d11383e1fe6417c48f7646f71b9b918.jpg not downloaded yet
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e699d90>
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_ce18e2a18cbd11ef04153d826a8c0137.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_ce18e2a18cbd11ef04153d826a8c0137.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da84550>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_c8590aecb7a2f98e3c53c16e62f7cd08.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c8590aecb7a2f98e3c53c16e62f7cd08.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_ba05798f870601f65b1afde21970dc0c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_ba05798f870601f65b1afde21970dc0c.jpg not downloaded yet
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_079b23d8a73d72f0d7af306dd2d560eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_079b23d8a73d72f0d7af306dd2d560eb.jpg not downloaded yet
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_607af7e4fe530c50662f16a28be39b19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_607af7e4fe530c50662f16a28be39b19.jpg not downloaded yet
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e0510>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_9b9e13de65a10e1cee774d0ba35dff8f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_9b9e13de65a10e1cee774d0ba35dff8f.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_86fcf49d21d61465bb77d8457ee5c4c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_86fcf49d21d61465bb77d8457ee5c4c7.jpg not downloaded yet
2025-12-05 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7a5efd2c518535d2e4a47d0995caf2db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_80abc32ddd4635518a10b314317d4ae8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_b7cdbf42165dd8cba9d3998375094e33.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_b920bb3a807517a9c540922198875f2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_3dd4397bc3a6ce678733aa497ccc7297.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_584c723ee169754d44ef79eab6d4d49c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_cfdb7c949373f30eeaec49387cafcbe5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_cfdb7c949373f30eeaec49387cafcbe5.jpg not downloaded yet
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e72c549aa9ebec3862580b443fc14729.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e72c549aa9ebec3862580b443fc14729.jpg not downloaded yet
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_55e412fa77a8269eb8c4c6f39337ae6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_55e412fa77a8269eb8c4c6f39337ae6c.jpg not downloaded yet
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db85b50>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_02909069cc50ed03151274b2a7354f31.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_02909069cc50ed03151274b2a7354f31.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db66490>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_1cae56ac854eb576584cf6b3189470fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_1cae56ac854eb576584cf6b3189470fa.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e459790>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_8640077523ad871942eb7786aa7bdbff.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_8640077523ad871942eb7786aa7bdbff.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ed2d0>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_77c44add185c44a67882b6d4e0b369ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_77c44add185c44a67882b6d4e0b369ac.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfb050>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_0943376d39a36e55ee45cd6b4e0380fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_0943376d39a36e55ee45cd6b4e0380fc.jpg saved to cache
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275aff07-0091-53cb-be1c-bfb93b516083 with identifier: XH24581
2025-12-05 17:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275aff07-0091-53cb-be1c-bfb93b516083 with scrape type 2
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275aff07-0091-53cb-be1c-bfb93b516083 with scrape type 2
2025-12-05 17:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 275aff07-0091-53cb-be1c-bfb93b516083, identifier: XH24581
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dad4950>
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_4eb5d8379b10500b5a4afdc44e75dbf3.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_4eb5d8379b10500b5a4afdc44e75dbf3.jpg saved to cache
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74cb50>
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_e5a686d384745248512af357d6c2d69f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_e5a686d384745248512af357d6c2d69f.jpg saved to cache
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e11c73c201c1ae54640ca3c39933bd3a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_72f570b75d723752a77e316c0896dc0e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_89e43562a175d67af02687766a41a81e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_89e43562a175d67af02687766a41a81e.jpg not downloaded yet
2025-12-05 17:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 275aff07-0091-53cb-be1c-bfb93b516083 with identifier: XH24581
2025-12-05 17:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 275aff07-0091-53cb-be1c-bfb93b516083 with identifier: XH24581
2025-12-05 17:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 275aff07-0091-53cb-be1c-bfb93b516083 with identifier: XH24581 to the API
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XH24581>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 249,
 'expiration_date': '2025-12-06T16:46:37Z',
 'fuel_type': 'petrol',
 'id': '275aff07-0091-53cb-be1c-bfb93b516083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH24581',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 42915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque P250 Mild-Hybrid R-dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-dynamic SE',
 'year': 2022}
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH24581%27 HTTP/1.1" 200 None
2025-12-05 17:02:47 [auto1.es] INFO: Saving data for XH24581: {'auction_closing_time': 1765039597.0, 'created_time': 1763984992.38688, 'last_price_update_time': 1764954167.163419}
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH24581') HTTP/1.1" 204 0
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_0b32ccca959b691a350d7f7c85b4dcfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_0b32ccca959b691a350d7f7c85b4dcfa.jpg not downloaded yet
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_5e9c9df94126946339635e8404a4757e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_5e9c9df94126946339635e8404a4757e.jpg not downloaded yet
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_8519b00d0d00225450cf3f52a4b74a7a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_fcfd246931fcadc9635726d37b3ed957.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_fcfd246931fcadc9635726d37b3ed957.jpg not downloaded yet
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF92414> (referer: https://www.auto1.com/v1/car-details-view/EF92414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC72590> (referer: https://www.auto1.com/v1/car-details-view/DC72590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ49177> (referer: https://www.auto1.com/v1/car-details-view/AJ49177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e8590>
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_7a5efd2c518535d2e4a47d0995caf2db.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7a5efd2c518535d2e4a47d0995caf2db.jpg saved to cache
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a3890>
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_80abc32ddd4635518a10b314317d4ae8.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_80abc32ddd4635518a10b314317d4ae8.jpg saved to cache
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b1790>
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_b7cdbf42165dd8cba9d3998375094e33.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_b7cdbf42165dd8cba9d3998375094e33.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba1190>
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_b920bb3a807517a9c540922198875f2f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_b920bb3a807517a9c540922198875f2f.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e449850>
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_3dd4397bc3a6ce678733aa497ccc7297.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_3dd4397bc3a6ce678733aa497ccc7297.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47cf90>
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_584c723ee169754d44ef79eab6d4d49c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_584c723ee169754d44ef79eab6d4d49c.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_607af7e4fe530c50662f16a28be39b19.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_57bb47c62c50d1476bc4eea0802780ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_1bec3d678408c410a31288e87ff34919.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e5dd70cb8ead5dff135031f366f93f93.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_42a5caae8f57ab28ee4f5c3d03d8e3e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e4a2acddee7ade46d8c4b989bb16542a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e4a2acddee7ade46d8c4b989bb16542a.jpg not downloaded yet
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_7612df85b8b7746103fab9e2ed524d55.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7612df85b8b7746103fab9e2ed524d55.jpg not downloaded yet
2025-12-05 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_079b23d8a73d72f0d7af306dd2d560eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_62094282350df01d31e34dc162dadbe7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_62094282350df01d31e34dc162dadbe7.jpg not downloaded yet
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbf2150>
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e11c73c201c1ae54640ca3c39933bd3a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e11c73c201c1ae54640ca3c39933bd3a.jpg saved to cache
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f2b50>
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_72f570b75d723752a77e316c0896dc0e.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_72f570b75d723752a77e316c0896dc0e.jpg saved to cache
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_ba05798f870601f65b1afde21970dc0c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcdb10>
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_8519b00d0d00225450cf3f52a4b74a7a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_8519b00d0d00225450cf3f52a4b74a7a.jpg saved to cache
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8e7583-f30b-53ec-8d00-d7ec636e0136 with identifier: EF92414
2025-12-05 17:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8e7583-f30b-53ec-8d00-d7ec636e0136 with scrape type 2
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae8e7583-f30b-53ec-8d00-d7ec636e0136 with scrape type 2
2025-12-05 17:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae8e7583-f30b-53ec-8d00-d7ec636e0136, identifier: EF92414
2025-12-05 17:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40821f2-7a63-56c4-bd4b-1bf99c02d945 with identifier: DC72590
2025-12-05 17:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40821f2-7a63-56c4-bd4b-1bf99c02d945 with scrape type 2
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40821f2-7a63-56c4-bd4b-1bf99c02d945 with scrape type 2
2025-12-05 17:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d40821f2-7a63-56c4-bd4b-1bf99c02d945, identifier: DC72590
2025-12-05 17:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d7721e-c454-5504-b895-36c020b3c5f6 with identifier: AJ49177
2025-12-05 17:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d7721e-c454-5504-b895-36c020b3c5f6 with scrape type 2
2025-12-05 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88d7721e-c454-5504-b895-36c020b3c5f6 with scrape type 2
2025-12-05 17:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88d7721e-c454-5504-b895-36c020b3c5f6, identifier: AJ49177
2025-12-05 17:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_e3fc77d6aad34148e5f22a048abe4894.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_27e2f2f92f48aa38f25d831a7e3958db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_86fcf49d21d61465bb77d8457ee5c4c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_b9cb0ee32478cbd44289371bbbfbe9a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_b9cb0ee32478cbd44289371bbbfbe9a9.jpg not downloaded yet
2025-12-05 17:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae8e7583-f30b-53ec-8d00-d7ec636e0136 with identifier: EF92414
2025-12-05 17:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae8e7583-f30b-53ec-8d00-d7ec636e0136 with identifier: EF92414
2025-12-05 17:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ae8e7583-f30b-53ec-8d00-d7ec636e0136 with identifier: EF92414 to the API
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF92414>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:04:06Z',
 'fuel_type': 'diesel',
 'id': 'ae8e7583-f30b-53ec-8d00-d7ec636e0136',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF92414',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 113270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF92414%27 HTTP/1.1" 200 None
2025-12-05 17:02:50 [auto1.es] INFO: Saving data for EF92414: {'auction_closing_time': 1765037046.0, 'created_time': 1764850173.473361, 'last_price_update_time': 1764954170.637503}
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF92414') HTTP/1.1" 204 0
2025-12-05 17:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d40821f2-7a63-56c4-bd4b-1bf99c02d945 with identifier: DC72590
2025-12-05 17:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d40821f2-7a63-56c4-bd4b-1bf99c02d945 with identifier: DC72590
2025-12-05 17:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161478 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161478
2025-12-05 17:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d40821f2-7a63-56c4-bd4b-1bf99c02d945 spider: auto1.es
2025-12-05 17:02:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d40821f2-7a63-56c4-bd4b-1bf99c02d945 due to rule: high_mileage_for_country.json, error: 161478 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161478
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:26:07Z',
 'fuel_type': 'hybrid',
 'id': 'd40821f2-7a63-56c4-bd4b-1bf99c02d945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC72590',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 161478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Pack',
 'transmission': 'automatic',
 'trim': 'Pack',
 'year': 2016}
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC72590%27 HTTP/1.1" 200 None
2025-12-05 17:02:50 [auto1.es] INFO: Saving data for DC72590: {'auction_closing_time': 1765038367.0, 'created_time': 1764867697.140227, 'last_price_update_time': 1764954170.859807}
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DC72590') HTTP/1.1" 204 0
2025-12-05 17:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88d7721e-c454-5504-b895-36c020b3c5f6 with identifier: AJ49177
2025-12-05 17:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88d7721e-c454-5504-b895-36c020b3c5f6 with identifier: AJ49177
2025-12-05 17:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88d7721e-c454-5504-b895-36c020b3c5f6 with identifier: AJ49177 to the API
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ49177>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:30:14Z',
 'fuel_type': 'diesel',
 'id': '88d7721e-c454-5504-b895-36c020b3c5f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ49177',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 72102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ49177%27 HTTP/1.1" 200 None
2025-12-05 17:02:51 [auto1.es] INFO: Saving data for AJ49177: {'auction_closing_time': 1765038614.0, 'created_time': 1764762555.190947, 'last_price_update_time': 1764954171.169887}
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ49177') HTTP/1.1" 204 0
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_9d11383e1fe6417c48f7646f71b9b918.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_89e43562a175d67af02687766a41a81e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d4f3b10a6485c6958ffcfd9a2a464a96.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab7310>
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_607af7e4fe530c50662f16a28be39b19.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_607af7e4fe530c50662f16a28be39b19.jpg saved to cache
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7224d0>
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_57bb47c62c50d1476bc4eea0802780ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_57bb47c62c50d1476bc4eea0802780ba.jpg saved to cache
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9dfcd0>
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_1bec3d678408c410a31288e87ff34919.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_1bec3d678408c410a31288e87ff34919.jpg saved to cache
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e46f010>
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e5dd70cb8ead5dff135031f366f93f93.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e5dd70cb8ead5dff135031f366f93f93.jpg saved to cache
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690629450>
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_42a5caae8f57ab28ee4f5c3d03d8e3e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_42a5caae8f57ab28ee4f5c3d03d8e3e2.jpg saved to cache
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dadda50>
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_079b23d8a73d72f0d7af306dd2d560eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_079b23d8a73d72f0d7af306dd2d560eb.jpg saved to cache
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_5e9c9df94126946339635e8404a4757e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_0ff9695855eed1cfc63330420dd166e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0ff9695855eed1cfc63330420dd166e2.jpg not downloaded yet
2025-12-05 17:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_0b32ccca959b691a350d7f7c85b4dcfa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_d78f07673a01857247c3fb24c6e3a194.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_d78f07673a01857247c3fb24c6e3a194.jpg not downloaded yet
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db35e10>
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_ba05798f870601f65b1afde21970dc0c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_ba05798f870601f65b1afde21970dc0c.jpg saved to cache
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7038d0>
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_e3fc77d6aad34148e5f22a048abe4894.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_e3fc77d6aad34148e5f22a048abe4894.jpg saved to cache
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66905eda90>
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_27e2f2f92f48aa38f25d831a7e3958db.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_27e2f2f92f48aa38f25d831a7e3958db.jpg saved to cache
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7019d0>
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_86fcf49d21d61465bb77d8457ee5c4c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_86fcf49d21d61465bb77d8457ee5c4c7.jpg saved to cache
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d841a10>
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_9d11383e1fe6417c48f7646f71b9b918.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_9d11383e1fe6417c48f7646f71b9b918.jpg saved to cache
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66906de990>
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_89e43562a175d67af02687766a41a81e.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_89e43562a175d67af02687766a41a81e.jpg saved to cache
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb3c50>
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_d4f3b10a6485c6958ffcfd9a2a464a96.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d4f3b10a6485c6958ffcfd9a2a464a96.jpg saved to cache
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_55e412fa77a8269eb8c4c6f39337ae6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d6f4fe2c269d4a1b0af3206f3a8dad37.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_5a7366608b7e2ae404503c8749d84c07.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5a7366608b7e2ae404503c8749d84c07.jpg not downloaded yet
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_39e2251ee831db0457aaa21b298c5522.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e72c549aa9ebec3862580b443fc14729.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_8cac07f45412c29fbdcc8878a07a9551.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_cfdb7c949373f30eeaec49387cafcbe5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_fcfd246931fcadc9635726d37b3ed957.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_66b329e4473971d62730d09385d50703.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_66b329e4473971d62730d09385d50703.jpg not downloaded yet
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db61c50>
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_5e9c9df94126946339635e8404a4757e.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_5e9c9df94126946339635e8404a4757e.jpg saved to cache
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac15d0>
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_0b32ccca959b691a350d7f7c85b4dcfa.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_0b32ccca959b691a350d7f7c85b4dcfa.jpg saved to cache
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_cacdee426eca6e2f82275a37a895bd57.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_0c4257bb2526bd104a8027aa3347c0a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0c4257bb2526bd104a8027aa3347c0a1.jpg not downloaded yet
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f90f9bca0031d2c15d6c7b7797ccbf19.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_62094282350df01d31e34dc162dadbe7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_6e5ac13c7d6ae540220e08ec50e595ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7612df85b8b7746103fab9e2ed524d55.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e4a2acddee7ade46d8c4b989bb16542a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_b9cb0ee32478cbd44289371bbbfbe9a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e6112db47447dd3a5eb90d5d4d74583.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_97116d59ccb8905ce1e39f82a2d7ed42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_97116d59ccb8905ce1e39f82a2d7ed42.jpg not downloaded yet
2025-12-05 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e757b50>
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_55e412fa77a8269eb8c4c6f39337ae6c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_55e412fa77a8269eb8c4c6f39337ae6c.jpg saved to cache
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db8b550>
2025-12-05 17:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_d6f4fe2c269d4a1b0af3206f3a8dad37.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d6f4fe2c269d4a1b0af3206f3a8dad37.jpg saved to cache
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ad5d0>
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_39e2251ee831db0457aaa21b298c5522.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_39e2251ee831db0457aaa21b298c5522.jpg saved to cache
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbbee50>
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e72c549aa9ebec3862580b443fc14729.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e72c549aa9ebec3862580b443fc14729.jpg saved to cache
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e43f350>
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_8cac07f45412c29fbdcc8878a07a9551.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_8cac07f45412c29fbdcc8878a07a9551.jpg saved to cache
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f1450>
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F76%252Fcc76a12d4a5b64298b1e1aa95139065e%252Fpa%252FUC57851_cfdb7c949373f30eeaec49387cafcbe5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_cfdb7c949373f30eeaec49387cafcbe5.jpg saved to cache
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 14e7974a-8c41-57f2-80e3-f7ab51357438
2025-12-05 17:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14e7974a-8c41-57f2-80e3-f7ab51357438, skipping ID generation
2025-12-05 17:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e7974a-8c41-57f2-80e3-f7ab51357438 with scrape type 1
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14e7974a-8c41-57f2-80e3-f7ab51357438 from tracking dictionaries
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14e7974a-8c41-57f2-80e3-f7ab51357438 sending to next pipeline
2025-12-05 17:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14e7974a-8c41-57f2-80e3-f7ab51357438, identifier: UC57851
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbd8b90>
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_fcfd246931fcadc9635726d37b3ed957.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_fcfd246931fcadc9635726d37b3ed957.jpg saved to cache
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14e7974a-8c41-57f2-80e3-f7ab51357438 with identifier: UC57851
2025-12-05 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14e7974a-8c41-57f2-80e3-f7ab51357438 with identifier: UC57851
2025-12-05 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160328 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160328
2025-12-05 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 14e7974a-8c41-57f2-80e3-f7ab51357438 spider: auto1.es
2025-12-05 17:02:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 14e7974a-8c41-57f2-80e3-f7ab51357438 due to rule: high_mileage_for_country.json, error: 160328 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160328
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:44:41Z',
 'fuel_type': 'diesel',
 'id': '14e7974a-8c41-57f2-80e3-f7ab51357438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC57851',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 160328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_74f8780b10a9e3183ab125f8ace018af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_d0881e57156c1bc74905ba20f8ab8c9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_f3647e38af225696442f2ab97524e3e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_8cac07f45412c29fbdcc8878a07a9551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_39e2251ee831db0457aaa21b298c5522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_1347364c488804d39adf32955954cb31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_3dd4397bc3a6ce678733aa497ccc7297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_e5a686d384745248512af357d6c2d69f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_77c44add185c44a67882b6d4e0b369ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_0943376d39a36e55ee45cd6b4e0380fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_42a5caae8f57ab28ee4f5c3d03d8e3e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_57bb47c62c50d1476bc4eea0802780ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_72f570b75d723752a77e316c0896dc0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_27e2f2f92f48aa38f25d831a7e3958db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_ba05798f870601f65b1afde21970dc0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e7974a-8c41-57f2-80e3-f7ab51357438/14e7974a-8c41-57f2-80e3-f7ab51357438_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/76/cc76a12d4a5b64298b1e1aa95139065e/pa/UC57851_cfdb7c949373f30eeaec49387cafcbe5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC57851%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.es] INFO: Saving data for UC57851: {'created_time': 1764954178.007996, 'last_price_update_time': 1764954178.008008, 'auction_closing_time': 1765039481.0}
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC57851') HTTP/1.1" 204 0
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_5d5428c4aa4bcaa402ceedc18bfd81c2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5d5428c4aa4bcaa402ceedc18bfd81c2.jpg not downloaded yet
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_d78f07673a01857247c3fb24c6e3a194.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_66b329e4473971d62730d09385d50703.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0ff9695855eed1cfc63330420dd166e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da46a10>
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_cacdee426eca6e2f82275a37a895bd57.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_cacdee426eca6e2f82275a37a895bd57.jpg saved to cache
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97fb10>
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_f90f9bca0031d2c15d6c7b7797ccbf19.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f90f9bca0031d2c15d6c7b7797ccbf19.jpg saved to cache
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97e410>
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_62094282350df01d31e34dc162dadbe7.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_62094282350df01d31e34dc162dadbe7.jpg saved to cache
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dafb8d0>
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_6e5ac13c7d6ae540220e08ec50e595ca.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_6e5ac13c7d6ae540220e08ec50e595ca.jpg saved to cache
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbf88d0>
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F3e%252Fb23e0225bf4f440ba894e543f8338094%252Fpa%252FBL02071_7612df85b8b7746103fab9e2ed524d55.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7612df85b8b7746103fab9e2ed524d55.jpg saved to cache
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee
2025-12-05 17:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee, skipping ID generation
2025-12-05 17:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee with scrape type 1
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee from tracking dictionaries
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee sending to next pipeline
2025-12-05 17:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee, identifier: BL02071
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8e9890>
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450827ae7267e941efff6998b9cd558%252Fpa%252FCZ23225_e4a2acddee7ade46d8c4b989bb16542a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e4a2acddee7ade46d8c4b989bb16542a.jpg saved to cache
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019
2025-12-05 17:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bb3f6ed-2abf-5a24-86a3-507634d2b019, skipping ID generation
2025-12-05 17:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019 with scrape type 1
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3bb3f6ed-2abf-5a24-86a3-507634d2b019 from tracking dictionaries
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bb3f6ed-2abf-5a24-86a3-507634d2b019 sending to next pipeline
2025-12-05 17:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3bb3f6ed-2abf-5a24-86a3-507634d2b019, identifier: CZ23225
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66905492d0>
2025-12-05 17:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_b9cb0ee32478cbd44289371bbbfbe9a9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_b9cb0ee32478cbd44289371bbbfbe9a9.jpg saved to cache
2025-12-05 17:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d932b10>
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_3e6112db47447dd3a5eb90d5d4d74583.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e6112db47447dd3a5eb90d5d4d74583.jpg saved to cache
2025-12-05 17:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_6d3559264330f7fbeede947dfd80cbe5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7311216e7880bce8b59cf927721cb2fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_faf0c47d7885df1fd62507ebdc71ee76.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg not downloaded yet
2025-12-05 17:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee with identifier: BL02071
2025-12-05 17:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee with identifier: BL02071
2025-12-05 17:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee with identifier: BL02071 to the API
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7612df85b8b7746103fab9e2ed524d55.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 13,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 313,
 'expiration_date': '2025-12-06T16:28:39Z',
 'fuel_type': 'hybrid',
 'id': '15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL02071',
 'listing': 'auction',
 'location': 'ES, Sabadell',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 52827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_68647061a362cc8405482ac09161ece5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_6b107c04c5fa30dd66ad403315c06ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_973390c5be152169893273ad064726e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_0df06c33e6db4362cabcef77b48ba57b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_4eb5d8379b10500b5a4afdc44e75dbf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_ce18e2a18cbd11ef04153d826a8c0137.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_02909069cc50ed03151274b2a7354f31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_9b9e13de65a10e1cee774d0ba35dff8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_b920bb3a807517a9c540922198875f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_8519b00d0d00225450cf3f52a4b74a7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7a5efd2c518535d2e4a47d0995caf2db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_e3fc77d6aad34148e5f22a048abe4894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_607af7e4fe530c50662f16a28be39b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_55e412fa77a8269eb8c4c6f39337ae6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_5e9c9df94126946339635e8404a4757e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee/15fd3cf6-b0ac-5cfe-bf37-02dd9b0f0bee_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/3e/b23e0225bf4f440ba894e543f8338094/pa/BL02071_7612df85b8b7746103fab9e2ed524d55.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2022}
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL02071%27 HTTP/1.1" 200 None
2025-12-05 17:03:00 [auto1.es] INFO: Saving data for BL02071: {'created_time': 1764954180.923823, 'last_price_update_time': 1764954180.923833, 'auction_closing_time': 1765038519.0}
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BL02071') HTTP/1.1" 204 0
2025-12-05 17:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3bb3f6ed-2abf-5a24-86a3-507634d2b019 with identifier: CZ23225
2025-12-05 17:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3bb3f6ed-2abf-5a24-86a3-507634d2b019 with identifier: CZ23225
2025-12-05 17:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158465 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158465
2025-12-05 17:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3bb3f6ed-2abf-5a24-86a3-507634d2b019 spider: auto1.es
2025-12-05 17:03:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3bb3f6ed-2abf-5a24-86a3-507634d2b019 due to rule: high_mileage_for_country.json, error: 158465 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158465
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-06T16:39:58Z',
 'fuel_type': 'hybrid',
 'id': '3bb3f6ed-2abf-5a24-86a3-507634d2b019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ23225',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 158465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_48349d2445818ee1f4a2994ada2c0881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c3542fa31eeb8b08b65a730a1a49a192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d6f4fe2c269d4a1b0af3206f3a8dad37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_29a7a001e73b5236db6edf76ada5b499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_b7cdbf42165dd8cba9d3998375094e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_c8590aecb7a2f98e3c53c16e62f7cd08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_1cae56ac854eb576584cf6b3189470fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_8640077523ad871942eb7786aa7bdbff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_584c723ee169754d44ef79eab6d4d49c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e5dd70cb8ead5dff135031f366f93f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e11c73c201c1ae54640ca3c39933bd3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_d4f3b10a6485c6958ffcfd9a2a464a96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_079b23d8a73d72f0d7af306dd2d560eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e72c549aa9ebec3862580b443fc14729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_0b32ccca959b691a350d7f7c85b4dcfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bb3f6ed-2abf-5a24-86a3-507634d2b019/3bb3f6ed-2abf-5a24-86a3-507634d2b019_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450827ae7267e941efff6998b9cd558/pa/CZ23225_e4a2acddee7ade46d8c4b989bb16542a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2017}
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ23225%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.es] INFO: Saving data for CZ23225: {'created_time': 1764954181.155133, 'last_price_update_time': 1764954181.155143, 'auction_closing_time': 1765039198.0}
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ23225') HTTP/1.1" 204 0
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0c4257bb2526bd104a8027aa3347c0a1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5a7366608b7e2ae404503c8749d84c07.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da29fd0>
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9d%252F749d167382ecff397b17c21623a187de%252Fpa%252FHP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg saved to cache
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2
2025-12-05 17:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f655b12-ca56-5c2a-a9ac-6d26469b08b2, skipping ID generation
2025-12-05 17:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 with scrape type 1
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 from tracking dictionaries
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 sending to next pipeline
2025-12-05 17:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f655b12-ca56-5c2a-a9ac-6d26469b08b2, identifier: HP20815
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e755fd0>
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_d78f07673a01857247c3fb24c6e3a194.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_d78f07673a01857247c3fb24c6e3a194.jpg saved to cache
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97e390>
2025-12-05 17:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_66b329e4473971d62730d09385d50703.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_66b329e4473971d62730d09385d50703.jpg saved to cache
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da45590>
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_0ff9695855eed1cfc63330420dd166e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0ff9695855eed1cfc63330420dd166e2.jpg saved to cache
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 with identifier: HP20815
2025-12-05 17:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 with identifier: HP20815
2025-12-05 17:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f655b12-ca56-5c2a-a9ac-6d26469b08b2 with identifier: HP20815 to the API
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2025-12-06T16:01:16Z',
 'fuel_type': 'petrol',
 'id': '0f655b12-ca56-5c2a-a9ac-6d26469b08b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP20815',
 'listing': 'auction',
 'location': 'ES, Córdoba',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 103145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_fd3b35fcf4d9bc251b5b684219addeb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_51df784c73c3019aa22c635909f741e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_6e5ac13c7d6ae540220e08ec50e595ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f90f9bca0031d2c15d6c7b7797ccbf19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_4d67f0c52cee819d70bf0daddbf65477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9314dc0c746b1835de95b22f6f442f56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_bf0558d54dc20e7e505d2a6a2500ccf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_dfcc493c6f61c8e92ce91e75ead5a93e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_56ff301752ddf85da6da0d06730e9b3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_20512ad20407296ebd9ff0ec5fa66c1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_d60760d059cf71c381f5d6ae7e7d6894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_161bb2b5c3b6e649b39072f268c30f0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_f060360af2d32733320df291d27c6fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_8e55967475e5ead3b0238301f0b5d18c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_e057a8e4b4ac6dd6ff49a0ee9afface1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f655b12-ca56-5c2a-a9ac-6d26469b08b2/0f655b12-ca56-5c2a-a9ac-6d26469b08b2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9d/749d167382ecff397b17c21623a187de/pa/HP20815_9b1f634360637bda763ec85580c38749.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP20815%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.es] INFO: Saving data for HP20815: {'created_time': 1764954182.810254, 'last_price_update_time': 1764954182.810265, 'auction_closing_time': 1765036876.0}
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HP20815') HTTP/1.1" 204 0
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a7ed0>
2025-12-05 17:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_6d3559264330f7fbeede947dfd80cbe5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_6d3559264330f7fbeede947dfd80cbe5.jpg saved to cache
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbf9950>
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_7311216e7880bce8b59cf927721cb2fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7311216e7880bce8b59cf927721cb2fc.jpg saved to cache
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a6650>
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ffb%252F3ffb953d456646f09f2f0506e510d20c%252Fpa%252FFS87361_faf0c47d7885df1fd62507ebdc71ee76.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_faf0c47d7885df1fd62507ebdc71ee76.jpg saved to cache
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69
2025-12-05 17:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69, skipping ID generation
2025-12-05 17:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 with scrape type 1
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 from tracking dictionaries
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 sending to next pipeline
2025-12-05 17:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69, identifier: FS87361
2025-12-05 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_97116d59ccb8905ce1e39f82a2d7ed42.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5d5428c4aa4bcaa402ceedc18bfd81c2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 with identifier: FS87361
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2025-12-05 17:03:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 with identifier: FS87361
2025-12-05 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
2025-12-05 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 spider: auto1.es
2025-12-05 17:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 072f1ee6-0a8b-5feb-bb9b-08f99cf11c69 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:36:04Z',
 'fuel_type': 'diesel',
 'id': '072f1ee6-0a8b-5feb-bb9b-08f99cf11c69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS87361',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 87581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_6d3559264330f7fbeede947dfd80cbe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_faf0c47d7885df1fd62507ebdc71ee76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7311216e7880bce8b59cf927721cb2fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_cacdee426eca6e2f82275a37a895bd57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e6112db47447dd3a5eb90d5d4d74583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_a4990bd29cfed911e248116449bab938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_7a64c1fc43d69b6a45ce4313ddea0799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_e6dc27d2da2bd4c3caa8029d270f27b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_35736cdbd4c11d76cff842c1631fd658.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_998cbc110f4f385ed7390083c6f47949.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_db4368fcbf834356a4e613053fd415c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_2060e45243eede21a090d05935cc7fb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_174f49767efae1c05ebc80259f25123a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_072f1ee6-0a8b-5feb-bb9b-08f99cf11c69/072f1ee6-0a8b-5feb-bb9b-08f99cf11c69_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/fb/3ffb953d456646f09f2f0506e510d20c/pa/FS87361_3e0276c7731d67d1443a160504800d8c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
 'transmission': 'automatic',
 'trim': 'Ocean FWD',
 'year': 2022}
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS87361%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.es] INFO: Saving data for FS87361: {'created_time': 1764954184.189074, 'last_price_update_time': 1764954184.189086, 'auction_closing_time': 1765038964.0}
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FS87361') HTTP/1.1" 204 0
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ51509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW74191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED74766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG92089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT13320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD44553> (referer: https://www.auto1.com/v1/car-details-view/TD44553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6e590>
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_0c4257bb2526bd104a8027aa3347c0a1.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0c4257bb2526bd104a8027aa3347c0a1.jpg saved to cache
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e619310>
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_5a7366608b7e2ae404503c8749d84c07.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5a7366608b7e2ae404503c8749d84c07.jpg saved to cache
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f3410>
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_97116d59ccb8905ce1e39f82a2d7ed42.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_97116d59ccb8905ce1e39f82a2d7ed42.jpg saved to cache
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe16d0>
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_5d5428c4aa4bcaa402ceedc18bfd81c2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5d5428c4aa4bcaa402ceedc18bfd81c2.jpg saved to cache
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75eeffa4-2745-59c7-b608-e73d2f55eaa7 with identifier: TD44553
2025-12-05 17:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7 with scrape type 1
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_b0bd7dc84d69c1d529a3323a5bc9aad2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_b0bd7dc84d69c1d529a3323a5bc9aad2.jpg not downloaded yet
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_9b62025befff58a2e8f2336daf0eb15c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_9b62025befff58a2e8f2336daf0eb15c.jpg not downloaded yet
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX94287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ67726> (referer: https://www.auto1.com/v1/car-details-view/CZ67726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e78bed0>
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Ff2%252F22f256f7c783e1543b8a2c2ed2e10332%252Fpa%252FTN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg saved to cache
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6d4646df-d265-523f-b271-5e2a5013487e
2025-12-05 17:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d4646df-d265-523f-b271-5e2a5013487e, skipping ID generation
2025-12-05 17:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4646df-d265-523f-b271-5e2a5013487e with scrape type 1
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6d4646df-d265-523f-b271-5e2a5013487e from tracking dictionaries
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d4646df-d265-523f-b271-5e2a5013487e sending to next pipeline
2025-12-05 17:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d4646df-d265-523f-b271-5e2a5013487e, identifier: TN61769
2025-12-05 17:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d4646df-d265-523f-b271-5e2a5013487e with identifier: TN61769
2025-12-05 17:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d4646df-d265-523f-b271-5e2a5013487e with identifier: TN61769
2025-12-05 17:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d4646df-d265-523f-b271-5e2a5013487e with identifier: TN61769 to the API
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:50:55Z',
 'fuel_type': 'petrol',
 'id': '6d4646df-d265-523f-b271-5e2a5013487e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN61769',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 116349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_80abc32ddd4635518a10b314317d4ae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_1bec3d678408c410a31288e87ff34919.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_9d11383e1fe6417c48f7646f71b9b918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_86fcf49d21d61465bb77d8457ee5c4c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_89e43562a175d67af02687766a41a81e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_fcfd246931fcadc9635726d37b3ed957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_62094282350df01d31e34dc162dadbe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_b9cb0ee32478cbd44289371bbbfbe9a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0ff9695855eed1cfc63330420dd166e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_d78f07673a01857247c3fb24c6e3a194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5a7366608b7e2ae404503c8749d84c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_66b329e4473971d62730d09385d50703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_0c4257bb2526bd104a8027aa3347c0a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_97116d59ccb8905ce1e39f82a2d7ed42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_5d5428c4aa4bcaa402ceedc18bfd81c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4646df-d265-523f-b271-5e2a5013487e/6d4646df-d265-523f-b271-5e2a5013487e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/f2/22f256f7c783e1543b8a2c2ed2e10332/pa/TN61769_693bdfd502f3b6f60b08a55f42e73fa7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN61769%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [auto1.es] INFO: Saving data for TN61769: {'created_time': 1764954186.183372, 'last_price_update_time': 1764954186.183383, 'auction_closing_time': 1765039855.0}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TN61769') HTTP/1.1" 204 0
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_7d887e34dbe232ac4a2c6da5038d4c8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_7d887e34dbe232ac4a2c6da5038d4c8f.jpg not downloaded yet
2025-12-05 17:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebf9aed-e582-5d65-8277-6f7ecebe13d2 with identifier: CZ67726
2025-12-05 17:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebf9aed-e582-5d65-8277-6f7ecebe13d2 with scrape type 2
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cebf9aed-e582-5d65-8277-6f7ecebe13d2 with scrape type 2
2025-12-05 17:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cebf9aed-e582-5d65-8277-6f7ecebe13d2, identifier: CZ67726
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_e924c84775aa64513de4d6e1fac1dc95.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_e924c84775aa64513de4d6e1fac1dc95.jpg not downloaded yet
2025-12-05 17:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cebf9aed-e582-5d65-8277-6f7ecebe13d2 with identifier: CZ67726
2025-12-05 17:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cebf9aed-e582-5d65-8277-6f7ecebe13d2 with identifier: CZ67726
2025-12-05 17:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176042 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176042
2025-12-05 17:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cebf9aed-e582-5d65-8277-6f7ecebe13d2 spider: auto1.es
2025-12-05 17:03:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cebf9aed-e582-5d65-8277-6f7ecebe13d2 due to rule: high_mileage_for_country.json, error: 176042 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176042
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:04:16Z',
 'fuel_type': 'hybrid',
 'id': 'cebf9aed-e582-5d65-8277-6f7ecebe13d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ67726',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 176042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2020}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ67726%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [auto1.es] INFO: Saving data for CZ67726: {'auction_closing_time': 1765037056.0, 'created_time': 1762347489.42689, 'last_price_update_time': 1764954186.607297}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ67726') HTTP/1.1" 204 0
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_b0bd7dc84d69c1d529a3323a5bc9aad2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_2cf10430a43828877e1f25a33016b2f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_2cf10430a43828877e1f25a33016b2f5.jpg not downloaded yet
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_af11f91e5c7f83a5a834311b0a70ac51.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_af11f91e5c7f83a5a834311b0a70ac51.jpg not downloaded yet
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_0e036271727dc040c4867b4fcd6fcc9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_0e036271727dc040c4867b4fcd6fcc9b.jpg not downloaded yet
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_9b62025befff58a2e8f2336daf0eb15c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_8a331e0658ad9960fe8f4f773a8cc084.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8a331e0658ad9960fe8f4f773a8cc084.jpg not downloaded yet
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_7d887e34dbe232ac4a2c6da5038d4c8f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_08255e70496c606e4c9ff4f1e8abb27d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_08255e70496c606e4c9ff4f1e8abb27d.jpg not downloaded yet
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_8deccc7a3bcd6ba75d02f16b49a1cc8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8deccc7a3bcd6ba75d02f16b49a1cc8d.jpg not downloaded yet
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_e924c84775aa64513de4d6e1fac1dc95.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_2cf10430a43828877e1f25a33016b2f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_946d0cd32ba1b0abf9ddce3cc5db5a1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_946d0cd32ba1b0abf9ddce3cc5db5a1d.jpg not downloaded yet
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6ead0>
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_b0bd7dc84d69c1d529a3323a5bc9aad2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_b0bd7dc84d69c1d529a3323a5bc9aad2.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_af11f91e5c7f83a5a834311b0a70ac51.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_88022fe0c5226f23eeec56bf75c05515.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_88022fe0c5226f23eeec56bf75c05515.jpg not downloaded yet
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_0e036271727dc040c4867b4fcd6fcc9b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8a331e0658ad9960fe8f4f773a8cc084.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_08255e70496c606e4c9ff4f1e8abb27d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_c4f4870f92a726c1658214f8c35130a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c4f4870f92a726c1658214f8c35130a4.jpg not downloaded yet
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc32890>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_9b62025befff58a2e8f2336daf0eb15c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_9b62025befff58a2e8f2336daf0eb15c.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cc690>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_7d887e34dbe232ac4a2c6da5038d4c8f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_7d887e34dbe232ac4a2c6da5038d4c8f.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc30890>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_e924c84775aa64513de4d6e1fac1dc95.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_e924c84775aa64513de4d6e1fac1dc95.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc31c90>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_2cf10430a43828877e1f25a33016b2f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_2cf10430a43828877e1f25a33016b2f5.jpg saved to cache
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_c577486df9bee6d6aa94ee29390319b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c577486df9bee6d6aa94ee29390319b8.jpg not downloaded yet
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8deccc7a3bcd6ba75d02f16b49a1cc8d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_946d0cd32ba1b0abf9ddce3cc5db5a1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_ba5e30c9d2c30e8bd4282b3498924733.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_ba5e30c9d2c30e8bd4282b3498924733.jpg not downloaded yet
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT13320> (referer: https://www.auto1.com/v1/car-details-view/CT13320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW74191> (referer: https://www.auto1.com/v1/car-details-view/RW74191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED74766> (referer: https://www.auto1.com/v1/car-details-view/ED74766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ51509> (referer: https://www.auto1.com/v1/car-details-view/ZJ51509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:08 [scrapy.extensions.logstats] INFO: Crawled 330 pages (at 82 pages/min), scraped 99 items (at 28 items/min)
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5644d0>
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_af11f91e5c7f83a5a834311b0a70ac51.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_af11f91e5c7f83a5a834311b0a70ac51.jpg saved to cache
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da94590>
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_0e036271727dc040c4867b4fcd6fcc9b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_0e036271727dc040c4867b4fcd6fcc9b.jpg saved to cache
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e747750>
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_8a331e0658ad9960fe8f4f773a8cc084.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8a331e0658ad9960fe8f4f773a8cc084.jpg saved to cache
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e557050>
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_08255e70496c606e4c9ff4f1e8abb27d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_08255e70496c606e4c9ff4f1e8abb27d.jpg saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:09 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_88022fe0c5226f23eeec56bf75c05515.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_90c68002f27b26b2100d67d1f2ce4032.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_90c68002f27b26b2100d67d1f2ce4032.jpg not downloaded yet
2025-12-05 17:03:09 [auto1.es] INFO: Found listing with ID: TD44553
2025-12-05 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c4f4870f92a726c1658214f8c35130a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX94287> (referer: https://www.auto1.com/v1/car-details-view/WX94287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:09 [auto1.es] INFO: Found listing with ID: KB59454
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB59454%27 HTTP/1.1" 200 None
2025-12-05 17:03:09 [auto1.es] INFO: Scrape type for KB59454: 1
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e58a8d0>
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_8deccc7a3bcd6ba75d02f16b49a1cc8d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8deccc7a3bcd6ba75d02f16b49a1cc8d.jpg saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db37dd0>
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_946d0cd32ba1b0abf9ddce3cc5db5a1d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_946d0cd32ba1b0abf9ddce3cc5db5a1d.jpg saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 322c35f4-b90b-543f-b728-c3c2876514b9 with identifier: CT13320
2025-12-05 17:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322c35f4-b90b-543f-b728-c3c2876514b9 with scrape type 2
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 322c35f4-b90b-543f-b728-c3c2876514b9 with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 322c35f4-b90b-543f-b728-c3c2876514b9, identifier: CT13320
2025-12-05 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c17bbd3-2280-593d-a4cd-716085e82911 with identifier: RW74191
2025-12-05 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c17bbd3-2280-593d-a4cd-716085e82911 with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c17bbd3-2280-593d-a4cd-716085e82911 with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c17bbd3-2280-593d-a4cd-716085e82911, identifier: RW74191
2025-12-05 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943e844e-b1e6-5372-ba2a-ca04d6b2f97d with identifier: ED74766
2025-12-05 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943e844e-b1e6-5372-ba2a-ca04d6b2f97d with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 943e844e-b1e6-5372-ba2a-ca04d6b2f97d with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 943e844e-b1e6-5372-ba2a-ca04d6b2f97d, identifier: ED74766
2025-12-05 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc6ce003-f976-5186-8e37-3b11d2b4b71a with identifier: ZJ51509
2025-12-05 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6ce003-f976-5186-8e37-3b11d2b4b71a with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc6ce003-f976-5186-8e37-3b11d2b4b71a with scrape type 2
2025-12-05 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cc6ce003-f976-5186-8e37-3b11d2b4b71a, identifier: ZJ51509
2025-12-05 17:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 322c35f4-b90b-543f-b728-c3c2876514b9 with identifier: CT13320
2025-12-05 17:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 322c35f4-b90b-543f-b728-c3c2876514b9 with identifier: CT13320
2025-12-05 17:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 322c35f4-b90b-543f-b728-c3c2876514b9 with identifier: CT13320 to the API
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CT13320>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:35:26Z',
 'fuel_type': 'petrol',
 'id': '322c35f4-b90b-543f-b728-c3c2876514b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT13320',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 48865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2022}
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT13320%27 HTTP/1.1" 200 None
2025-12-05 17:03:10 [auto1.es] INFO: Saving data for CT13320: {'auction_closing_time': 1765038926.0, 'created_time': 1764850473.766583, 'last_price_update_time': 1764954190.688655}
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT13320') HTTP/1.1" 204 0
2025-12-05 17:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c17bbd3-2280-593d-a4cd-716085e82911 with identifier: RW74191
2025-12-05 17:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c17bbd3-2280-593d-a4cd-716085e82911 with identifier: RW74191
2025-12-05 17:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c17bbd3-2280-593d-a4cd-716085e82911 with identifier: RW74191 to the API
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RW74191>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:58:23Z',
 'fuel_type': 'diesel',
 'id': '7c17bbd3-2280-593d-a4cd-716085e82911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW74191',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 46410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW74191%27 HTTP/1.1" 200 None
2025-12-05 17:03:11 [auto1.es] INFO: Saving data for RW74191: {'auction_closing_time': 1765040303.0, 'created_time': 1760702926.436264, 'last_price_update_time': 1764954191.035193}
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RW74191') HTTP/1.1" 204 0
2025-12-05 17:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 943e844e-b1e6-5372-ba2a-ca04d6b2f97d with identifier: ED74766
2025-12-05 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 943e844e-b1e6-5372-ba2a-ca04d6b2f97d with identifier: ED74766
2025-12-05 17:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 943e844e-b1e6-5372-ba2a-ca04d6b2f97d with identifier: ED74766 to the API
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED74766>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:05:45Z',
 'fuel_type': 'diesel',
 'id': '943e844e-b1e6-5372-ba2a-ca04d6b2f97d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED74766',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 88262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2017}
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED74766%27 HTTP/1.1" 200 None
2025-12-05 17:03:11 [auto1.es] INFO: Saving data for ED74766: {'auction_closing_time': 1765037145.0, 'created_time': 1764762804.499795, 'last_price_update_time': 1764954191.351732}
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ED74766') HTTP/1.1" 204 0
2025-12-05 17:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cc6ce003-f976-5186-8e37-3b11d2b4b71a with identifier: ZJ51509
2025-12-05 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cc6ce003-f976-5186-8e37-3b11d2b4b71a with identifier: ZJ51509
2025-12-05 17:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cc6ce003-f976-5186-8e37-3b11d2b4b71a with identifier: ZJ51509 to the API
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ51509>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:36:52Z',
 'fuel_type': 'petrol',
 'id': 'cc6ce003-f976-5186-8e37-3b11d2b4b71a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ51509',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Fiat',
 'model': '500',
 'odometer': 19583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ51509%27 HTTP/1.1" 200 None
2025-12-05 17:03:11 [auto1.es] INFO: Saving data for ZJ51509: {'auction_closing_time': 1765039012.0, 'created_time': 1764850037.962965, 'last_price_update_time': 1764954191.670763}
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ51509') HTTP/1.1" 204 0
2025-12-05 17:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c577486df9bee6d6aa94ee29390319b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:11 [auto1.es] INFO: Found listing with ID: UA06139
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA06139%27 HTTP/1.1" 200 None
2025-12-05 17:03:11 [auto1.es] INFO: Scrape type for UA06139: 2
2025-12-05 17:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_ba5e30c9d2c30e8bd4282b3498924733.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ee750>
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_88022fe0c5226f23eeec56bf75c05515.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_88022fe0c5226f23eeec56bf75c05515.jpg saved to cache
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5c41d0>
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_c4f4870f92a726c1658214f8c35130a4.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c4f4870f92a726c1658214f8c35130a4.jpg saved to cache
2025-12-05 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287
2025-12-05 17:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with scrape type 2
2025-12-05 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with scrape type 2
2025-12-05 17:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9, identifier: WX94287
2025-12-05 17:03:12 [auto1.es] INFO: Found listing with ID: AC35975
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC35975%27 HTTP/1.1" 200 None
2025-12-05 17:03:12 [auto1.es] INFO: Scrape type for AC35975: 1
2025-12-05 17:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287
2025-12-05 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287
2025-12-05 17:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287 to the API
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WX94287>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:32:16Z',
 'fuel_type': 'diesel',
 'id': 'd737a7b6-e857-56a1-9ae2-f9ae1ff866b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX94287',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 129412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2018}
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX94287%27 HTTP/1.1" 200 None
2025-12-05 17:03:13 [auto1.es] INFO: Saving data for WX94287: {'auction_closing_time': 1765038736.0, 'created_time': 1764850000.186918, 'last_price_update_time': 1764954193.158947}
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WX94287') HTTP/1.1" 204 0
2025-12-05 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_90c68002f27b26b2100d67d1f2ce4032.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:13 [auto1.es] INFO: Found listing with ID: DH01871
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH01871%27 HTTP/1.1" 200 None
2025-12-05 17:03:13 [auto1.es] INFO: Scrape type for DH01871: 1
2025-12-05 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:13 [auto1.es] INFO: Found listing with ID: TW44451
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW44451%27 HTTP/1.1" 200 None
2025-12-05 17:03:13 [auto1.es] INFO: Scrape type for TW44451: 1
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d862390>
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_c577486df9bee6d6aa94ee29390319b8.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c577486df9bee6d6aa94ee29390319b8.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e567050>
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_ba5e30c9d2c30e8bd4282b3498924733.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_ba5e30c9d2c30e8bd4282b3498924733.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:13 [auto1.es] INFO: Found listing with ID: KX32813
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX32813%27 HTTP/1.1" 200 None
2025-12-05 17:03:13 [auto1.es] INFO: Scrape type for KX32813: 1
2025-12-05 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:13 [auto1.es] INFO: Found listing with ID: ZT88716
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT88716%27 HTTP/1.1" 200 None
2025-12-05 17:03:13 [auto1.es] INFO: Scrape type for ZT88716: 1
2025-12-05 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061b6d0>
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffb%252F64fbea4fd3c481a5654f913454edd441%252Fpa%252FTD44553_90c68002f27b26b2100d67d1f2ce4032.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_90c68002f27b26b2100d67d1f2ce4032.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7
2025-12-05 17:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75eeffa4-2745-59c7-b608-e73d2f55eaa7, skipping ID generation
2025-12-05 17:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7 with scrape type 1
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 75eeffa4-2745-59c7-b608-e73d2f55eaa7 from tracking dictionaries
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75eeffa4-2745-59c7-b608-e73d2f55eaa7 sending to next pipeline
2025-12-05 17:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75eeffa4-2745-59c7-b608-e73d2f55eaa7, identifier: TD44553
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: TG43536
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG43536%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for TG43536: 2
2025-12-05 17:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75eeffa4-2745-59c7-b608-e73d2f55eaa7 with identifier: TD44553
2025-12-05 17:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75eeffa4-2745-59c7-b608-e73d2f55eaa7 with identifier: TD44553
2025-12-05 17:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75eeffa4-2745-59c7-b608-e73d2f55eaa7 with identifier: TD44553 to the API
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_90c68002f27b26b2100d67d1f2ce4032.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 460,
 'expiration_date': '2025-12-06T16:49:21Z',
 'fuel_type': 'petrol',
 'id': '75eeffa4-2745-59c7-b608-e73d2f55eaa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD44553',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '2er',
 'odometer': 10071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_b0bd7dc84d69c1d529a3323a5bc9aad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_9b62025befff58a2e8f2336daf0eb15c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_7d887e34dbe232ac4a2c6da5038d4c8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_e924c84775aa64513de4d6e1fac1dc95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_2cf10430a43828877e1f25a33016b2f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_af11f91e5c7f83a5a834311b0a70ac51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_0e036271727dc040c4867b4fcd6fcc9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8a331e0658ad9960fe8f4f773a8cc084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_08255e70496c606e4c9ff4f1e8abb27d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_8deccc7a3bcd6ba75d02f16b49a1cc8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_946d0cd32ba1b0abf9ddce3cc5db5a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_88022fe0c5226f23eeec56bf75c05515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c4f4870f92a726c1658214f8c35130a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_c577486df9bee6d6aa94ee29390319b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_ba5e30c9d2c30e8bd4282b3498924733.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75eeffa4-2745-59c7-b608-e73d2f55eaa7/75eeffa4-2745-59c7-b608-e73d2f55eaa7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fb/64fbea4fd3c481a5654f913454edd441/pa/TD44553_90c68002f27b26b2100d67d1f2ce4032.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 2er M2',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD44553%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Saving data for TD44553: {'created_time': 1764954194.434892, 'last_price_update_time': 1764954194.434901, 'auction_closing_time': 1765039761.0}
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TD44553') HTTP/1.1" 204 0
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: LB21635
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB21635%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for LB21635: 1
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB59454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: HA84076
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA84076%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for HA84076: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: VS88612
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VS88612%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for VS88612: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: TJ01598
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ01598%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for TJ01598: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: BB66547
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB66547%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for BB66547: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: EP18291
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP18291%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for EP18291: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: BP61591
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for BP61591: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: DT53511
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT53511%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for DT53511: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: KZ79788
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ79788%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for KZ79788: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: YC38257
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC38257%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for YC38257: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: SJ98968
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ98968%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for SJ98968: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: LV46847
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV46847%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for LV46847: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: TY01455
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY01455%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for TY01455: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: CW74431
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW74431%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for CW74431: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: RT52527
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT52527%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for RT52527: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: NM91287
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM91287%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for NM91287: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: VL29575
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL29575%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for VL29575: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: YR71719
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for YR71719: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: DC81161
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC81161%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for DC81161: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: TJ60930
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ60930%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for TJ60930: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: MY29147
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY29147%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for MY29147: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: PH33066
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH33066%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for PH33066: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: LV12827
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV12827%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for LV12827: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: TP89248
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP89248%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for TP89248: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: KG65087
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG65087%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for KG65087: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: SL11544
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL11544%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for SL11544: 1
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: YM25003
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM25003%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for YM25003: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: LS17468
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS17468%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for LS17468: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: HL11058
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL11058%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for HL11058: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: TB70012
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB70012%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for TB70012: 2
2025-12-05 17:03:14 [auto1.es] INFO: Found listing with ID: HE24471
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE24471%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.es] INFO: Scrape type for HE24471: 2
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA06139/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC35975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW44451/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH01871/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT88716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX32813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB21635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG92089> (referer: https://www.auto1.com/v1/car-details-view/TG92089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG43536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e46e4a1e-f163-596d-80cc-620c747a598a with identifier: TG92089
2025-12-05 17:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46e4a1e-f163-596d-80cc-620c747a598a with scrape type 2
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e46e4a1e-f163-596d-80cc-620c747a598a with scrape type 2
2025-12-05 17:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e46e4a1e-f163-596d-80cc-620c747a598a, identifier: TG92089
2025-12-05 17:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e46e4a1e-f163-596d-80cc-620c747a598a with identifier: TG92089
2025-12-05 17:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e46e4a1e-f163-596d-80cc-620c747a598a with identifier: TG92089
2025-12-05 17:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e46e4a1e-f163-596d-80cc-620c747a598a with identifier: TG92089 to the API
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27e46e4a1e-f163-596d-80cc-620c747a598a%27 HTTP/1.1" 200 None
2025-12-05 17:03:16 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id e46e4a1e-f163-596d-80cc-620c747a598a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 17:03:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 17:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TG92089>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:35:11Z',
 'fuel_type': 'diesel',
 'id': 'e46e4a1e-f163-596d-80cc-620c747a598a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG92089',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 64104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2017}
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG92089%27 HTTP/1.1" 200 None
2025-12-05 17:03:16 [auto1.es] INFO: Saving data for TG92089: {'auction_closing_time': 1765038911.0, 'created_time': 1764762798.911066, 'last_price_update_time': 1764954196.42133}
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG92089') HTTP/1.1" 204 0
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ01598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA84076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB66547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: NE80053
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE80053%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for NE80053: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: SG82420
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG82420%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for SG82420: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: BL31812
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL31812%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for BL31812: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: TW60593
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW60593%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for TW60593: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: BR76643
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR76643%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for BR76643: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: MY60582
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY60582%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for MY60582: 2
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP18291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: DL32817
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL32817%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for DL32817: 2
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: SE12357
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE12357%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for SE12357: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: UR76133
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR76133%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for UR76133: 1
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: VW66972
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW66972%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for VW66972: 2
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE24471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP61591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: XN67881
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN67881%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for XN67881: 2
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: BE60241
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE60241%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for BE60241: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: GK85431
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK85431%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for GK85431: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: CV01854
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for CV01854: 2
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB70012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: XM12351
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM12351%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for XM12351: 2
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: XH32538
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH32538%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for XH32538: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: ZA13852
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA13852%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for ZA13852: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: CU54513
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU54513%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for CU54513: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: HJ28079
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ28079%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for HJ28079: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: SV28926
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV28926%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for SV28926: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: LP81684
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP81684%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for LP81684: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: BT53297
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for BT53297: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: KZ03674
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ03674%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for KZ03674: 2
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL11058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: VF21943
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF21943%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for VF21943: 0
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: NA90839
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for NA90839: 2
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: PT21379
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT21379%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for PT21379: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: VF19064
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF19064%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for VF19064: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: EG10760
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG10760%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for EG10760: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: XG84496
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG84496%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for XG84496: 1
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: ZL80540
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for ZL80540: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: GA10352
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA10352%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for GA10352: 1
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: KH29076
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH29076%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for KH29076: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: ZV49987
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV49987%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for ZV49987: 1
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: WS63080
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS63080%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for WS63080: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: FR23839
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR23839%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for FR23839: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: EM12264
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM12264%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for EM12264: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: AN43784
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN43784%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for AN43784: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: ZN58653
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN58653%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for ZN58653: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: MY68664
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY68664%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for MY68664: 2
2025-12-05 17:03:17 [auto1.es] INFO: Found listing with ID: LH83138
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH83138%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [auto1.es] INFO: Scrape type for LH83138: 2
2025-12-05 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS17468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS88612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH01871> (referer: https://www.auto1.com/v1/car-details-view/DH01871/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT88716> (referer: https://www.auto1.com/v1/car-details-view/ZT88716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039bdf98-c022-51c4-aa9f-a8c8b0b57057 with identifier: DH01871
2025-12-05 17:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057 with scrape type 1
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_9c8ef37680686ee2a7c532ec7474931f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9c8ef37680686ee2a7c532ec7474931f.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_562b8f7a8f85450c122b4e853a544015.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_562b8f7a8f85450c122b4e853a544015.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_66864afd42ad346b187f3930e105af69.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_66864afd42ad346b187f3930e105af69.jpg not downloaded yet
2025-12-05 17:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e781267d-4c3d-5ea3-a8d8-edc060a853e8 with identifier: ZT88716
2025-12-05 17:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e781267d-4c3d-5ea3-a8d8-edc060a853e8 with scrape type 1
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_0afb81cf9b3f27590b00acc0bfb59d81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_0afb81cf9b3f27590b00acc0bfb59d81.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_b29629b75a3a77072f1da4920e04a72b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_b29629b75a3a77072f1da4920e04a72b.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_94861ecf7f04b7d52ca7b67b149af81d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_94861ecf7f04b7d52ca7b67b149af81d.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_e7837394b77b2c1465fb0da5fe241ad2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e7837394b77b2c1465fb0da5fe241ad2.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_4182e86c77988b9bf9ea0ad4e2a8b5f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_4182e86c77988b9bf9ea0ad4e2a8b5f5.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_a146a323185ca9d763fe0a3b92e9ec95.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_a146a323185ca9d763fe0a3b92e9ec95.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_8ce7265ce8572b86e19ccbf747533fab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8ce7265ce8572b86e19ccbf747533fab.jpg not downloaded yet
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW44451> (referer: https://www.auto1.com/v1/car-details-view/TW44451/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_2aafaf433c07bed1c35f353b8e214636.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_2aafaf433c07bed1c35f353b8e214636.jpg not downloaded yet
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_16146fe5f2e208ff2efa0beadefde03d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_16146fe5f2e208ff2efa0beadefde03d.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_9d7b4f3f3f0964112b9d5ff8883ec719.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_9d7b4f3f3f0964112b9d5ff8883ec719.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_51480f6a5054367c8fd75a6ca83d6209.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_51480f6a5054367c8fd75a6ca83d6209.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_573e826b0deeddb44955885a7f818e16.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_573e826b0deeddb44955885a7f818e16.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_32255c5ba5d621f13c0d5c4b2f3e14c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_32255c5ba5d621f13c0d5c4b2f3e14c3.jpg not downloaded yet
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX32813> (referer: https://www.auto1.com/v1/car-details-view/KX32813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_7476712c1002efb5039be48a895eb0aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_7476712c1002efb5039be48a895eb0aa.jpg not downloaded yet
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_dbfd1c392e2f0843baa2145bf8fb943c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dbfd1c392e2f0843baa2145bf8fb943c.jpg not downloaded yet
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC35975> (referer: https://www.auto1.com/v1/car-details-view/AC35975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53969ea5-c215-5800-bbde-17b5afb1445c with identifier: TW44451
2025-12-05 17:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53969ea5-c215-5800-bbde-17b5afb1445c with scrape type 1
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_12d9a9e0e81f9de815abdc48b1f3eb9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_12d9a9e0e81f9de815abdc48b1f3eb9c.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_680e6ad7d61b6e46ab815535ade92d3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_680e6ad7d61b6e46ab815535ade92d3f.jpg not downloaded yet
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_a146a323185ca9d763fe0a3b92e9ec95.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_9b359a1b50109f2793628dd2129bc16d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9b359a1b50109f2793628dd2129bc16d.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_75778ad4e673e774233eefebd605a32e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_75778ad4e673e774233eefebd605a32e.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_dd8fa5099046fd333f646495b4e0ec59.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dd8fa5099046fd333f646495b4e0ec59.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_c2c5d9f15c596c4eddeb98e921fe76b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c2c5d9f15c596c4eddeb98e921fe76b4.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_432df69a8171892d37f33439400ef7bf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_432df69a8171892d37f33439400ef7bf.jpg not downloaded yet
2025-12-05 17:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab with identifier: KX32813
2025-12-05 17:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab with scrape type 1
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_eefd2666a0b1658501b9db51e5f0e6e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_eefd2666a0b1658501b9db51e5f0e6e2.jpg not downloaded yet
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_32255c5ba5d621f13c0d5c4b2f3e14c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_11f67538c7b3623464308763c7acceb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_11f67538c7b3623464308763c7acceb1.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_9517df404bd4c381c55f0308f184f2ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_9517df404bd4c381c55f0308f184f2ec.jpg not downloaded yet
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_7476712c1002efb5039be48a895eb0aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_12d9a9e0e81f9de815abdc48b1f3eb9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_d2504d1f3d7a466a7af5d789c8ecd8ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_d2504d1f3d7a466a7af5d789c8ecd8ec.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_ec300fa699c1de83dd10d029d591a3cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ec300fa699c1de83dd10d029d591a3cd.jpg not downloaded yet
2025-12-05 17:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01afc78f-5898-5ade-9dcd-934c804dcdd0 with identifier: AC35975
2025-12-05 17:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01afc78f-5898-5ade-9dcd-934c804dcdd0 with scrape type 1
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 01afc78f-5898-5ade-9dcd-934c804dcdd0
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_2214573b9f8e679e99fcf2adac358cbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_2214573b9f8e679e99fcf2adac358cbe.jpg already downloaded
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_950737f5fc5a0674c6752f466ec953b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_950737f5fc5a0674c6752f466ec953b7.jpg already downloaded
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_7309855c258e7bec6600110ca63e84de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_7309855c258e7bec6600110ca63e84de.jpg already downloaded
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_4c0c1d8ff8d375f2caa38b844e5207d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_4c0c1d8ff8d375f2caa38b844e5207d6.jpg already downloaded
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_d0869b3808d9b750a52af2ac9502498b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_d0869b3808d9b750a52af2ac9502498b.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_9b9309e25386ae55f80bb3aaffaf2c85.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_9b9309e25386ae55f80bb3aaffaf2c85.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_60e45dc0c91f44d5e322057568b78f51.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_60e45dc0c91f44d5e322057568b78f51.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_34d1f8b8e177d7a45579d6dba3f2cd58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_34d1f8b8e177d7a45579d6dba3f2cd58.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_357aac33170afdc8d268652d1e6c988f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_357aac33170afdc8d268652d1e6c988f.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_89f78de2beb103097823d1e5fb19ecb8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_89f78de2beb103097823d1e5fb19ecb8.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_676ccd2d8f05dd434b37a63ec65ce165.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_676ccd2d8f05dd434b37a63ec65ce165.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_1e13c1f13d53a725200232e71c9d6129.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_1e13c1f13d53a725200232e71c9d6129.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_ca0e372f492684e3b4dce71b0738ca34.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_ca0e372f492684e3b4dce71b0738ca34.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_8a3421165affd49d30eb1c00902157ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_8a3421165affd49d30eb1c00902157ec.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_64b2b60606050e0ffe3d3276a0528866.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_64b2b60606050e0ffe3d3276a0528866.jpg already downloaded
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F0b%252Fd20bf42b147509e184769b02167db943%252Fpa%252FAC35975_57dc32a841a26aac8a83be13e695be49.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_57dc32a841a26aac8a83be13e695be49.jpg already downloaded
2025-12-05 17:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01afc78f-5898-5ade-9dcd-934c804dcdd0, identifier: AC35975
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_84c240e15d02b510259a737abc92f4a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_84c240e15d02b510259a737abc92f4a7.jpg not downloaded yet
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_ba1607b8be74c7a8abe0d0240db71b20.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ba1607b8be74c7a8abe0d0240db71b20.jpg not downloaded yet
2025-12-05 17:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01afc78f-5898-5ade-9dcd-934c804dcdd0 with identifier: AC35975
2025-12-05 17:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01afc78f-5898-5ade-9dcd-934c804dcdd0 with identifier: AC35975
2025-12-05 17:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01afc78f-5898-5ade-9dcd-934c804dcdd0 with identifier: AC35975 to the API
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AC35975>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:10:50Z',
 'fuel_type': 'diesel',
 'id': '01afc78f-5898-5ade-9dcd-934c804dcdd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC35975',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 64636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_2214573b9f8e679e99fcf2adac358cbe.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_950737f5fc5a0674c6752f466ec953b7.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_7309855c258e7bec6600110ca63e84de.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_4c0c1d8ff8d375f2caa38b844e5207d6.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_d0869b3808d9b750a52af2ac9502498b.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_9b9309e25386ae55f80bb3aaffaf2c85.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_60e45dc0c91f44d5e322057568b78f51.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_34d1f8b8e177d7a45579d6dba3f2cd58.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_357aac33170afdc8d268652d1e6c988f.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_89f78de2beb103097823d1e5fb19ecb8.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_676ccd2d8f05dd434b37a63ec65ce165.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_1e13c1f13d53a725200232e71c9d6129.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_ca0e372f492684e3b4dce71b0738ca34.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_8a3421165affd49d30eb1c00902157ec.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_64b2b60606050e0ffe3d3276a0528866.jpg',
                'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_57dc32a841a26aac8a83be13e695be49.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_2214573b9f8e679e99fcf2adac358cbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2971834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_950737f5fc5a0674c6752f466ec953b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_7309855c258e7bec6600110ca63e84de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_4c0c1d8ff8d375f2caa38b844e5207d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_d0869b3808d9b750a52af2ac9502498b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_9b9309e25386ae55f80bb3aaffaf2c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_60e45dc0c91f44d5e322057568b78f51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_34d1f8b8e177d7a45579d6dba3f2cd58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_357aac33170afdc8d268652d1e6c988f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_89f78de2beb103097823d1e5fb19ecb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_676ccd2d8f05dd434b37a63ec65ce165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_1e13c1f13d53a725200232e71c9d6129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_ca0e372f492684e3b4dce71b0738ca34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_8a3421165affd49d30eb1c00902157ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_64b2b60606050e0ffe3d3276a0528866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01afc78f-5898-5ade-9dcd-934c804dcdd0/01afc78f-5898-5ade-9dcd-934c804dcdd0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/0b/d20bf42b147509e184769b02167db943/pa/AC35975_57dc32a841a26aac8a83be13e695be49.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC35975%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [auto1.es] INFO: Saving data for AC35975: {'created_time': 1764954199.745703, 'last_price_update_time': 1764954199.745715, 'auction_closing_time': 1765037450.0}
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AC35975') HTTP/1.1" 204 0
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_aeaf549653f05f41b25098968f06a827.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_aeaf549653f05f41b25098968f06a827.jpg not downloaded yet
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_419c8e0647b1d39a8c26a8136a679c66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_419c8e0647b1d39a8c26a8136a679c66.jpg not downloaded yet
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_a13bfbc8a35e1cf7f1fb37431473e09b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_a13bfbc8a35e1cf7f1fb37431473e09b.jpg not downloaded yet
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_492e07762a11a217c91f054a34f8bbda.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_492e07762a11a217c91f054a34f8bbda.jpg not downloaded yet
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA06139> (referer: https://www.auto1.com/v1/car-details-view/UA06139/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB21635> (referer: https://www.auto1.com/v1/car-details-view/LB21635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA84076> (referer: https://www.auto1.com/v1/car-details-view/HA84076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ01598> (referer: https://www.auto1.com/v1/car-details-view/TJ01598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5a4850>
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_a146a323185ca9d763fe0a3b92e9ec95.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_a146a323185ca9d763fe0a3b92e9ec95.jpg saved to cache
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db60fd0>
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_32255c5ba5d621f13c0d5c4b2f3e14c3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_32255c5ba5d621f13c0d5c4b2f3e14c3.jpg saved to cache
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac13d0>
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_7476712c1002efb5039be48a895eb0aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_7476712c1002efb5039be48a895eb0aa.jpg saved to cache
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbeb790>
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_12d9a9e0e81f9de815abdc48b1f3eb9c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_12d9a9e0e81f9de815abdc48b1f3eb9c.jpg saved to cache
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_17de2439370d702f3ab77870968357a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_17de2439370d702f3ab77870968357a5.jpg not downloaded yet
2025-12-05 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY60582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_432df69a8171892d37f33439400ef7bf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_eefd2666a0b1658501b9db51e5f0e6e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c2c5d9f15c596c4eddeb98e921fe76b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_8f9df5cba2ffe8b8a4be9679a39d5b2d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8f9df5cba2ffe8b8a4be9679a39d5b2d.jpg not downloaded yet
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_e3f31395f0630c2b206159a042d3bec1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_e3f31395f0630c2b206159a042d3bec1.jpg not downloaded yet
2025-12-05 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_d9603670ede4dbdfd5796cd2287329a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d9603670ede4dbdfd5796cd2287329a5.jpg not downloaded yet
2025-12-05 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR76133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW66972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_5df089d7a9a5cc052b0f360a7442ea14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_5df089d7a9a5cc052b0f360a7442ea14.jpg not downloaded yet
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_fc41a0a711a7f48d817c72c652018b9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_fc41a0a711a7f48d817c72c652018b9c.jpg not downloaded yet
2025-12-05 17:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1 with identifier: UA06139
2025-12-05 17:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1 with scrape type 2
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1 with scrape type 2
2025-12-05 17:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1, identifier: UA06139
2025-12-05 17:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 with identifier: LB21635
2025-12-05 17:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 with scrape type 1
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_94efcc1c03fdc0f2ccf626fe304949ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_94efcc1c03fdc0f2ccf626fe304949ad.jpg not downloaded yet
2025-12-05 17:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71eb65d2-6055-59d3-8abc-0a0d94e5ad07 with identifier: HA84076
2025-12-05 17:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71eb65d2-6055-59d3-8abc-0a0d94e5ad07 with scrape type 2
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71eb65d2-6055-59d3-8abc-0a0d94e5ad07 with scrape type 2
2025-12-05 17:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71eb65d2-6055-59d3-8abc-0a0d94e5ad07, identifier: HA84076
2025-12-05 17:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db with identifier: TJ01598
2025-12-05 17:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db with scrape type 1
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_cdc09868b63f8a6340988b9289c2ed90.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_cdc09868b63f8a6340988b9289c2ed90.jpg not downloaded yet
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_6ad3430fd7168277fe4867d29f297f65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_6ad3430fd7168277fe4867d29f297f65.jpg not downloaded yet
2025-12-05 17:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1 with identifier: UA06139
2025-12-05 17:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1 with identifier: UA06139
2025-12-05 17:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 80000ef5-3264-52b8-b9ac-caeaaa4ecaa1 with identifier: UA06139 to the API
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA06139>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:00:02Z',
 'fuel_type': 'petrol',
 'id': '80000ef5-3264-52b8-b9ac-caeaaa4ecaa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA06139',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 95125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA06139%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [auto1.es] INFO: Saving data for UA06139: {'auction_closing_time': 1765036802.0, 'created_time': 1763547379.7402, 'last_price_update_time': 1764954201.608477}
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UA06139') HTTP/1.1" 204 0
2025-12-05 17:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71eb65d2-6055-59d3-8abc-0a0d94e5ad07 with identifier: HA84076
2025-12-05 17:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71eb65d2-6055-59d3-8abc-0a0d94e5ad07 with identifier: HA84076
2025-12-05 17:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71eb65d2-6055-59d3-8abc-0a0d94e5ad07 with identifier: HA84076 to the API
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA84076>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:42:10Z',
 'fuel_type': 'petrol',
 'id': '71eb65d2-6055-59d3-8abc-0a0d94e5ad07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA84076',
 'listing': 'auction',
 'location': 'ES, Lorca',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 119252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Color Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Color Edition Start/Stop',
 'year': 2017}
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA84076%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [auto1.es] INFO: Saving data for HA84076: {'auction_closing_time': 1765039330.0, 'created_time': 1764349638.345327, 'last_price_update_time': 1764954201.958902}
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA84076') HTTP/1.1" 204 0
2025-12-05 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_d2504d1f3d7a466a7af5d789c8ecd8ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_419c8e0647b1d39a8c26a8136a679c66.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_47a181c6af58e40362c91e3473eaa80d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_47a181c6af58e40362c91e3473eaa80d.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_ec38c7fe548a09a8d633873049e0b2c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ec38c7fe548a09a8d633873049e0b2c5.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_204aec709663925d9328cb410e2a3916.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_204aec709663925d9328cb410e2a3916.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_c65e702303ce326709081f4776ac71b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c65e702303ce326709081f4776ac71b1.jpg not downloaded yet
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_84c240e15d02b510259a737abc92f4a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_aeaf549653f05f41b25098968f06a827.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_492e07762a11a217c91f054a34f8bbda.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_a13bfbc8a35e1cf7f1fb37431473e09b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ba1607b8be74c7a8abe0d0240db71b20.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ec300fa699c1de83dd10d029d591a3cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_ffc7507b671973866b04c65c04aab8ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ffc7507b671973866b04c65c04aab8ff.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_1fb3cbfb664a0ed286b679fb674f40f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_1fb3cbfb664a0ed286b679fb674f40f7.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_8805dff6bbf5f93a6210e8f590912774.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8805dff6bbf5f93a6210e8f590912774.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_19e2b5bacb287f35231770e5509b4416.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_19e2b5bacb287f35231770e5509b4416.jpg not downloaded yet
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV01854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e8194d0>
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_432df69a8171892d37f33439400ef7bf.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_432df69a8171892d37f33439400ef7bf.jpg saved to cache
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e720550>
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_eefd2666a0b1658501b9db51e5f0e6e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_eefd2666a0b1658501b9db51e5f0e6e2.jpg saved to cache
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d89bbd0>
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_c2c5d9f15c596c4eddeb98e921fe76b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c2c5d9f15c596c4eddeb98e921fe76b4.jpg saved to cache
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_0395bf776f25054220a6ffb294fb838c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0395bf776f25054220a6ffb294fb838c.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_ddf6bcedc5cff6e32ad8b665b7ee748c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ddf6bcedc5cff6e32ad8b665b7ee748c.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_488fe8eccbfcd8e52bc551e747492ad8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_488fe8eccbfcd8e52bc551e747492ad8.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_4e863bfa369ae0ff8c43d04257e09f53.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_4e863bfa369ae0ff8c43d04257e09f53.jpg not downloaded yet
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8f9df5cba2ffe8b8a4be9679a39d5b2d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_e3f31395f0630c2b206159a042d3bec1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_3f9e9b8b43a07180b469049d20ee1c33.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_3f9e9b8b43a07180b469049d20ee1c33.jpg not downloaded yet
2025-12-05 17:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d88ba50>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_d2504d1f3d7a466a7af5d789c8ecd8ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_d2504d1f3d7a466a7af5d789c8ecd8ec.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6fcd10>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_419c8e0647b1d39a8c26a8136a679c66.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_419c8e0647b1d39a8c26a8136a679c66.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6fdb90>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_84c240e15d02b510259a737abc92f4a7.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_84c240e15d02b510259a737abc92f4a7.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5020d0>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_aeaf549653f05f41b25098968f06a827.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_aeaf549653f05f41b25098968f06a827.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ac4d0>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_492e07762a11a217c91f054a34f8bbda.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_492e07762a11a217c91f054a34f8bbda.jpg saved to cache
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5a4790>
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_a13bfbc8a35e1cf7f1fb37431473e09b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_a13bfbc8a35e1cf7f1fb37431473e09b.jpg saved to cache
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6f510>
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_ba1607b8be74c7a8abe0d0240db71b20.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ba1607b8be74c7a8abe0d0240db71b20.jpg saved to cache
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5f01d0>
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_ec300fa699c1de83dd10d029d591a3cd.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ec300fa699c1de83dd10d029d591a3cd.jpg saved to cache
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_cdc09868b63f8a6340988b9289c2ed90.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_64477b87a7286a2e935e1841c65b66db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_64477b87a7286a2e935e1841c65b66db.jpg not downloaded yet
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_a867154c7a517ccba5fdb3be6a80a1b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_a867154c7a517ccba5fdb3be6a80a1b5.jpg not downloaded yet
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_3dd09e431ef35bc238473e9d98817e49.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_3dd09e431ef35bc238473e9d98817e49.jpg not downloaded yet
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ec38c7fe548a09a8d633873049e0b2c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_94efcc1c03fdc0f2ccf626fe304949ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_204aec709663925d9328cb410e2a3916.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_47a181c6af58e40362c91e3473eaa80d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c65e702303ce326709081f4776ac71b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_d187e306a5bc2796ae705531e1f9279f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d187e306a5bc2796ae705531e1f9279f.jpg not downloaded yet
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ03674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS17468> (referer: https://www.auto1.com/v1/car-details-view/LS17468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH83138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS88612> (referer: https://www.auto1.com/v1/car-details-view/VS88612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_c52a464e898d02c36c757e1ed52a3802.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c52a464e898d02c36c757e1ed52a3802.jpg not downloaded yet
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_8ff10fd893ed487a8dcfda6b79998588.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8ff10fd893ed487a8dcfda6b79998588.jpg not downloaded yet
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_068d6744353fa73a465db5b5b705982e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_068d6744353fa73a465db5b5b705982e.jpg not downloaded yet
2025-12-05 17:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5618d0>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_8f9df5cba2ffe8b8a4be9679a39d5b2d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8f9df5cba2ffe8b8a4be9679a39d5b2d.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6cd550>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_e3f31395f0630c2b206159a042d3bec1.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_e3f31395f0630c2b206159a042d3bec1.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_fc41a0a711a7f48d817c72c652018b9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_e00cbb98175b7052e061b64d0197964f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_e00cbb98175b7052e061b64d0197964f.jpg not downloaded yet
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ffc7507b671973866b04c65c04aab8ff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_d6ed1fdcef7c926718bf4c6798848536.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_d6ed1fdcef7c926718bf4c6798848536.jpg not downloaded yet
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_11e6489304960a488a56ac54d9ea05bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_11e6489304960a488a56ac54d9ea05bb.jpg not downloaded yet
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_4e863bfa369ae0ff8c43d04257e09f53.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_6ad3430fd7168277fe4867d29f297f65.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0395bf776f25054220a6ffb294fb838c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_5144468e6630a2115d295674bae6d465.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5144468e6630a2115d295674bae6d465.jpg not downloaded yet
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_6c3a2f6fd00e35b486cc28362d0d4922.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_6c3a2f6fd00e35b486cc28362d0d4922.jpg not downloaded yet
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_975cb64f04e22cdcdf1dcf324bf045c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_975cb64f04e22cdcdf1dcf324bf045c9.jpg not downloaded yet
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ddf6bcedc5cff6e32ad8b665b7ee748c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_488fe8eccbfcd8e52bc551e747492ad8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_0c955ccc8f44c9d69f6b83309572da82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0c955ccc8f44c9d69f6b83309572da82.jpg not downloaded yet
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97e750>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_cdc09868b63f8a6340988b9289c2ed90.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_cdc09868b63f8a6340988b9289c2ed90.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b5250>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_ec38c7fe548a09a8d633873049e0b2c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ec38c7fe548a09a8d633873049e0b2c5.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9b23d0>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_94efcc1c03fdc0f2ccf626fe304949ad.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_94efcc1c03fdc0f2ccf626fe304949ad.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b56d0>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_204aec709663925d9328cb410e2a3916.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_204aec709663925d9328cb410e2a3916.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac9e10>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_47a181c6af58e40362c91e3473eaa80d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_47a181c6af58e40362c91e3473eaa80d.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6180d0>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_c65e702303ce326709081f4776ac71b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c65e702303ce326709081f4776ac71b1.jpg saved to cache
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5fd6bb3-c0d1-5caf-b54d-f579bead0341 with identifier: LS17468
2025-12-05 17:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5fd6bb3-c0d1-5caf-b54d-f579bead0341 with scrape type 2
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5fd6bb3-c0d1-5caf-b54d-f579bead0341 with scrape type 2
2025-12-05 17:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d5fd6bb3-c0d1-5caf-b54d-f579bead0341, identifier: LS17468
2025-12-05 17:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa84858-4184-5054-995d-27a1f3823dfe with identifier: VS88612
2025-12-05 17:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa84858-4184-5054-995d-27a1f3823dfe with scrape type 1
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_7cdf897d2bfb7192ae6506397dfa12bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_7cdf897d2bfb7192ae6506397dfa12bb.jpg not downloaded yet
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_a867154c7a517ccba5fdb3be6a80a1b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_64477b87a7286a2e935e1841c65b66db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_370d2720129cc809a891a9af067fba14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_370d2720129cc809a891a9af067fba14.jpg not downloaded yet
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_0704f6cbbeaf97fe0e7f16f311c7ec74.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_0704f6cbbeaf97fe0e7f16f311c7ec74.jpg not downloaded yet
2025-12-05 17:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d5fd6bb3-c0d1-5caf-b54d-f579bead0341 with identifier: LS17468
2025-12-05 17:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d5fd6bb3-c0d1-5caf-b54d-f579bead0341 with identifier: LS17468
2025-12-05 17:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178494 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178494
2025-12-05 17:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d5fd6bb3-c0d1-5caf-b54d-f579bead0341 spider: auto1.es
2025-12-05 17:03:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d5fd6bb3-c0d1-5caf-b54d-f579bead0341 due to rule: high_mileage_for_country.json, error: 178494 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178494
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2025-12-06T16:21:41Z',
 'fuel_type': 'petrol',
 'id': 'd5fd6bb3-c0d1-5caf-b54d-f579bead0341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS17468',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 178494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2017}
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS17468%27 HTTP/1.1" 200 None
2025-12-05 17:03:27 [auto1.es] INFO: Saving data for LS17468: {'auction_closing_time': 1765038101.0, 'created_time': 1761631344.535828, 'last_price_update_time': 1764954207.712621}
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS17468') HTTP/1.1" 204 0
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_3dd09e431ef35bc238473e9d98817e49.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_068d6744353fa73a465db5b5b705982e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_5b92751a4d2ba4231b95f14b28570572.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5b92751a4d2ba4231b95f14b28570572.jpg not downloaded yet
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_a8c72402de5ec0192099df84cf917bee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_a8c72402de5ec0192099df84cf917bee.jpg not downloaded yet
2025-12-05 17:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8735d0>
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_fc41a0a711a7f48d817c72c652018b9c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_fc41a0a711a7f48d817c72c652018b9c.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e675710>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_ffc7507b671973866b04c65c04aab8ff.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ffc7507b671973866b04c65c04aab8ff.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_e00cbb98175b7052e061b64d0197964f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_3f9e9b8b43a07180b469049d20ee1c33.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8ff10fd893ed487a8dcfda6b79998588.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_af70ace402519f87045d303d5b2e2482.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_af70ace402519f87045d303d5b2e2482.jpg not downloaded yet
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_7ab4004998696b16b555cb4209670915.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_7ab4004998696b16b555cb4209670915.jpg not downloaded yet
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW66972> (referer: https://www.auto1.com/v1/car-details-view/VW66972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY68664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c52a464e898d02c36c757e1ed52a3802.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_2589d47e72ea5afc7dcef2f7dab55582.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_2589d47e72ea5afc7dcef2f7dab55582.jpg not downloaded yet
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_8f537e473e9be67e5997b26b63a7bc15.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8f537e473e9be67e5997b26b63a7bc15.jpg not downloaded yet
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e8094d0>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_4e863bfa369ae0ff8c43d04257e09f53.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_4e863bfa369ae0ff8c43d04257e09f53.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcaf50>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_6ad3430fd7168277fe4867d29f297f65.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_6ad3430fd7168277fe4867d29f297f65.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc85d0>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_0395bf776f25054220a6ffb294fb838c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0395bf776f25054220a6ffb294fb838c.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4e9dd0>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_ddf6bcedc5cff6e32ad8b665b7ee748c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ddf6bcedc5cff6e32ad8b665b7ee748c.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfcc50>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_488fe8eccbfcd8e52bc551e747492ad8.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_488fe8eccbfcd8e52bc551e747492ad8.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da20a10>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_a867154c7a517ccba5fdb3be6a80a1b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_a867154c7a517ccba5fdb3be6a80a1b5.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbdf050>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_64477b87a7286a2e935e1841c65b66db.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_64477b87a7286a2e935e1841c65b66db.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_ccad7cb67498676a41ac4d557b77878b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ccad7cb67498676a41ac4d557b77878b.jpg not downloaded yet
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_c588fda91c3bdd443ae99976ecc8be2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c588fda91c3bdd443ae99976ecc8be2f.jpg not downloaded yet
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfebd0>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_3dd09e431ef35bc238473e9d98817e49.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_3dd09e431ef35bc238473e9d98817e49.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8cb610>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_068d6744353fa73a465db5b5b705982e.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_068d6744353fa73a465db5b5b705982e.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_11e6489304960a488a56ac54d9ea05bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_fa7ee939953857ac568ecf3bcc9c9cc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_fa7ee939953857ac568ecf3bcc9c9cc9.jpg not downloaded yet
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_279968f1dd82b3ca66b55cd9583fb529.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_279968f1dd82b3ca66b55cd9583fb529.jpg not downloaded yet
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_7cdf897d2bfb7192ae6506397dfa12bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d187e306a5bc2796ae705531e1f9279f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5144468e6630a2115d295674bae6d465.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0c955ccc8f44c9d69f6b83309572da82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg not downloaded yet
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_dbdc1b0c873449393ff5f64e4abe7c41.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dbdc1b0c873449393ff5f64e4abe7c41.jpg not downloaded yet
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV01854> (referer: https://www.auto1.com/v1/car-details-view/CV01854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY60582> (referer: https://www.auto1.com/v1/car-details-view/MY60582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR76133> (referer: https://www.auto1.com/v1/car-details-view/UR76133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e761710>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_e00cbb98175b7052e061b64d0197964f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_e00cbb98175b7052e061b64d0197964f.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f8990>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_3f9e9b8b43a07180b469049d20ee1c33.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_3f9e9b8b43a07180b469049d20ee1c33.jpg saved to cache
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e568450>
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_8ff10fd893ed487a8dcfda6b79998588.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8ff10fd893ed487a8dcfda6b79998588.jpg saved to cache
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad14913d-7777-5caa-9630-7c6c8534c7be with identifier: VW66972
2025-12-05 17:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad14913d-7777-5caa-9630-7c6c8534c7be with scrape type 2
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad14913d-7777-5caa-9630-7c6c8534c7be with scrape type 2
2025-12-05 17:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad14913d-7777-5caa-9630-7c6c8534c7be, identifier: VW66972
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e635f50>
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_c52a464e898d02c36c757e1ed52a3802.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c52a464e898d02c36c757e1ed52a3802.jpg saved to cache
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_975cb64f04e22cdcdf1dcf324bf045c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_0704f6cbbeaf97fe0e7f16f311c7ec74.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_370d2720129cc809a891a9af067fba14.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_668573e5b81fbfb756f983af8ab48a68.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_668573e5b81fbfb756f983af8ab48a68.jpg not downloaded yet
2025-12-05 17:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad14913d-7777-5caa-9630-7c6c8534c7be with identifier: VW66972
2025-12-05 17:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad14913d-7777-5caa-9630-7c6c8534c7be with identifier: VW66972
2025-12-05 17:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173831 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173831
2025-12-05 17:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ad14913d-7777-5caa-9630-7c6c8534c7be spider: auto1.es
2025-12-05 17:03:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ad14913d-7777-5caa-9630-7c6c8534c7be due to rule: high_mileage_for_country.json, error: 173831 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173831
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:48:06Z',
 'fuel_type': 'diesel',
 'id': 'ad14913d-7777-5caa-9630-7c6c8534c7be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW66972',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 173831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2018}
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW66972%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [auto1.es] INFO: Saving data for VW66972: {'auction_closing_time': 1765039686.0, 'created_time': 1759165354.140858, 'last_price_update_time': 1764954212.194739}
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VW66972') HTTP/1.1" 204 0
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_9f61617862ba88aca3e4d79151d2a353.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_9f61617862ba88aca3e4d79151d2a353.jpg not downloaded yet
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_319a12dcfe31b4e9e17b1e440290ea57.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_319a12dcfe31b4e9e17b1e440290ea57.jpg not downloaded yet
2025-12-05 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5b92751a4d2ba4231b95f14b28570572.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_b1c0459237bf78e32f3f98519f3429d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b1c0459237bf78e32f3f98519f3429d3.jpg not downloaded yet
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e481850>
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_11e6489304960a488a56ac54d9ea05bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_11e6489304960a488a56ac54d9ea05bb.jpg saved to cache
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e501a10>
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_7cdf897d2bfb7192ae6506397dfa12bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_7cdf897d2bfb7192ae6506397dfa12bb.jpg saved to cache
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db76850>
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_d187e306a5bc2796ae705531e1f9279f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d187e306a5bc2796ae705531e1f9279f.jpg saved to cache
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8f3dd0>
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_5144468e6630a2115d295674bae6d465.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5144468e6630a2115d295674bae6d465.jpg saved to cache
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6def50>
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_0c955ccc8f44c9d69f6b83309572da82.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0c955ccc8f44c9d69f6b83309572da82.jpg saved to cache
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2025-12-05 17:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dab811f-8fdc-55f4-8aea-8196cd84998d with scrape type 2
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dab811f-8fdc-55f4-8aea-8196cd84998d with scrape type 2
2025-12-05 17:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7dab811f-8fdc-55f4-8aea-8196cd84998d, identifier: CV01854
2025-12-05 17:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f53d75-781f-519e-9440-7ea08c6c0c3b with identifier: MY60582
2025-12-05 17:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f53d75-781f-519e-9440-7ea08c6c0c3b with scrape type 2
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1f53d75-781f-519e-9440-7ea08c6c0c3b with scrape type 2
2025-12-05 17:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f1f53d75-781f-519e-9440-7ea08c6c0c3b, identifier: MY60582
2025-12-05 17:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2 with identifier: UR76133
2025-12-05 17:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2 with scrape type 1
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_477e0c0b8032e51955a81179bf6ac8c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_477e0c0b8032e51955a81179bf6ac8c9.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_8529f6119a8a8f7be2db032822ec7b89.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_8529f6119a8a8f7be2db032822ec7b89.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_d5d115d6d9100aece4a2a3d82e739075.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_d5d115d6d9100aece4a2a3d82e739075.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_add3c5d0955b26737793996e8796389c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_add3c5d0955b26737793996e8796389c.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_24cdc49966d09004cc44321ff09bb77b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_24cdc49966d09004cc44321ff09bb77b.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_c57f7c9bf31d90f6c8601b487367fdf4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_c57f7c9bf31d90f6c8601b487367fdf4.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_a5dd31bf8f2ad82a45154f7fbf66309d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_a5dd31bf8f2ad82a45154f7fbf66309d.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_1cf95c9eb6deb7940bfde533d929f333.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_1cf95c9eb6deb7940bfde533d929f333.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_8b2a643d0617d9518598150317892788.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_8b2a643d0617d9518598150317892788.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_ecfbcb8a03539bcbb3a98f8a81780124.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_ecfbcb8a03539bcbb3a98f8a81780124.jpg already downloaded
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_0d22e50a34a8fe5f4178dd942dbd1238.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_0d22e50a34a8fe5f4178dd942dbd1238.jpg already downloaded
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_4db4197bdd2fa1dfa74f064ef109f872.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_4db4197bdd2fa1dfa74f064ef109f872.jpg already downloaded
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_be75d3043fb7a439863b7277a9157372.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_be75d3043fb7a439863b7277a9157372.jpg already downloaded
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_08c6ce44fc28d0d6c11025ab391496f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_08c6ce44fc28d0d6c11025ab391496f4.jpg already downloaded
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_fcd9c74b921a2dab30a96775b5255a7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_fcd9c74b921a2dab30a96775b5255a7c.jpg already downloaded
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbd%252Fcdbda37a8f716be018e9bdcfe1578a42%252Fpa%252FUR76133_d92ada222994591d6e39bea9a5c7b4a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_d92ada222994591d6e39bea9a5c7b4a1.jpg already downloaded
2025-12-05 17:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2, identifier: UR76133
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8f537e473e9be67e5997b26b63a7bc15.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_6c3a2f6fd00e35b486cc28362d0d4922.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_a8c72402de5ec0192099df84cf917bee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_a96e7d88564141bdef8578a0c2c4aa38.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a96e7d88564141bdef8578a0c2c4aa38.jpg not downloaded yet
2025-12-05 17:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172539 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172539
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7dab811f-8fdc-55f4-8aea-8196cd84998d spider: auto1.es
2025-12-05 17:03:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7dab811f-8fdc-55f4-8aea-8196cd84998d due to rule: high_mileage_for_country.json, error: 172539 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172539
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:23:02Z',
 'fuel_type': 'diesel',
 'id': '7dab811f-8fdc-55f4-8aea-8196cd84998d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV01854',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '2er',
 'odometer': 172539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [auto1.es] INFO: Saving data for CV01854: {'auction_closing_time': 1765038182.0, 'created_time': 1762966987.316982, 'last_price_update_time': 1764954214.438626}
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV01854') HTTP/1.1" 204 0
2025-12-05 17:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f1f53d75-781f-519e-9440-7ea08c6c0c3b with identifier: MY60582
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f1f53d75-781f-519e-9440-7ea08c6c0c3b with identifier: MY60582
2025-12-05 17:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f1f53d75-781f-519e-9440-7ea08c6c0c3b with identifier: MY60582 to the API
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MY60582>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2025-12-06T16:23:36Z',
 'fuel_type': 'petrol',
 'id': 'f1f53d75-781f-519e-9440-7ea08c6c0c3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY60582',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 64769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Drive 2WD',
 'transmission': 'manual',
 'trim': 'Drive 2WD',
 'year': 2018}
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY60582%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [auto1.es] INFO: Saving data for MY60582: {'auction_closing_time': 1765038216.0, 'created_time': 1764240382.071876, 'last_price_update_time': 1764954214.873799}
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY60582') HTTP/1.1" 204 0
2025-12-05 17:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2 with identifier: UR76133
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2 with identifier: UR76133
2025-12-05 17:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2 with identifier: UR76133 to the API
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UR76133>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:42:13Z',
 'fuel_type': 'petrol',
 'id': '1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR76133',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 77865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_477e0c0b8032e51955a81179bf6ac8c9.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_8529f6119a8a8f7be2db032822ec7b89.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_d5d115d6d9100aece4a2a3d82e739075.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_add3c5d0955b26737793996e8796389c.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_24cdc49966d09004cc44321ff09bb77b.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_c57f7c9bf31d90f6c8601b487367fdf4.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_a5dd31bf8f2ad82a45154f7fbf66309d.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_1cf95c9eb6deb7940bfde533d929f333.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_8b2a643d0617d9518598150317892788.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_ecfbcb8a03539bcbb3a98f8a81780124.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_0d22e50a34a8fe5f4178dd942dbd1238.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_4db4197bdd2fa1dfa74f064ef109f872.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_be75d3043fb7a439863b7277a9157372.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_08c6ce44fc28d0d6c11025ab391496f4.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_fcd9c74b921a2dab30a96775b5255a7c.jpg',
                'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_d92ada222994591d6e39bea9a5c7b4a1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2277111,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_477e0c0b8032e51955a81179bf6ac8c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_8529f6119a8a8f7be2db032822ec7b89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_d5d115d6d9100aece4a2a3d82e739075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2305234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_add3c5d0955b26737793996e8796389c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_24cdc49966d09004cc44321ff09bb77b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_c57f7c9bf31d90f6c8601b487367fdf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_a5dd31bf8f2ad82a45154f7fbf66309d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_1cf95c9eb6deb7940bfde533d929f333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_8b2a643d0617d9518598150317892788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_ecfbcb8a03539bcbb3a98f8a81780124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_0d22e50a34a8fe5f4178dd942dbd1238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_4db4197bdd2fa1dfa74f064ef109f872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_be75d3043fb7a439863b7277a9157372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_08c6ce44fc28d0d6c11025ab391496f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_fcd9c74b921a2dab30a96775b5255a7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2/1a5cc7b3-d62c-5d01-a28a-bd0350f8b7b2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bd/cdbda37a8f716be018e9bdcfe1578a42/pa/UR76133_d92ada222994591d6e39bea9a5c7b4a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR76133%27 HTTP/1.1" 200 None
2025-12-05 17:03:35 [auto1.es] INFO: Saving data for UR76133: {'created_time': 1764954215.221984, 'last_price_update_time': 1764954215.221994, 'auction_closing_time': 1765039333.0}
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR76133') HTTP/1.1" 204 0
2025-12-05 17:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ccad7cb67498676a41ac4d557b77878b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c588fda91c3bdd443ae99976ecc8be2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_0f211209de379c373425c5ef5e31c7b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_0f211209de379c373425c5ef5e31c7b7.jpg not downloaded yet
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e549f50>
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_975cb64f04e22cdcdf1dcf324bf045c9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_975cb64f04e22cdcdf1dcf324bf045c9.jpg saved to cache
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e560a50>
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_0704f6cbbeaf97fe0e7f16f311c7ec74.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_0704f6cbbeaf97fe0e7f16f311c7ec74.jpg saved to cache
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e549090>
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_370d2720129cc809a891a9af067fba14.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_370d2720129cc809a891a9af067fba14.jpg saved to cache
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_279968f1dd82b3ca66b55cd9583fb529.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_7ab4004998696b16b555cb4209670915.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_2589d47e72ea5afc7dcef2f7dab55582.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_f4722245df9099a65fbd4b0ddfc0b236.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f4722245df9099a65fbd4b0ddfc0b236.jpg not downloaded yet
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8faf50>
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_5b92751a4d2ba4231b95f14b28570572.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5b92751a4d2ba4231b95f14b28570572.jpg saved to cache
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_de30d3d255b0cc0ca68f88bc0439a7fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_de30d3d255b0cc0ca68f88bc0439a7fa.jpg not downloaded yet
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da22390>
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_8f537e473e9be67e5997b26b63a7bc15.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8f537e473e9be67e5997b26b63a7bc15.jpg saved to cache
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9e7dd0>
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_6c3a2f6fd00e35b486cc28362d0d4922.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_6c3a2f6fd00e35b486cc28362d0d4922.jpg saved to cache
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6525d0>
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_a8c72402de5ec0192099df84cf917bee.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_a8c72402de5ec0192099df84cf917bee.jpg saved to cache
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_af70ace402519f87045d303d5b2e2482.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_d6ed1fdcef7c926718bf4c6798848536.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_fa7ee939953857ac568ecf3bcc9c9cc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_dcc14ed2e3f25b126b1324f19d3326c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dcc14ed2e3f25b126b1324f19d3326c8.jpg not downloaded yet
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e0fd0>
2025-12-05 17:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_ccad7cb67498676a41ac4d557b77878b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ccad7cb67498676a41ac4d557b77878b.jpg saved to cache
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e564810>
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_c588fda91c3bdd443ae99976ecc8be2f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c588fda91c3bdd443ae99976ecc8be2f.jpg saved to cache
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_19e2b5bacb287f35231770e5509b4416.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8805dff6bbf5f93a6210e8f590912774.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_ec47e64b23ccbb6ff4dd8d1c62f8f41c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_ec47e64b23ccbb6ff4dd8d1c62f8f41c.jpg not downloaded yet
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb09d0>
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_279968f1dd82b3ca66b55cd9583fb529.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_279968f1dd82b3ca66b55cd9583fb529.jpg saved to cache
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a7f50>
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_7ab4004998696b16b555cb4209670915.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_7ab4004998696b16b555cb4209670915.jpg saved to cache
2025-12-05 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e80a710>
2025-12-05 17:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_2589d47e72ea5afc7dcef2f7dab55582.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_2589d47e72ea5afc7dcef2f7dab55582.jpg saved to cache
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_9f61617862ba88aca3e4d79151d2a353.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_668573e5b81fbfb756f983af8ab48a68.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_319a12dcfe31b4e9e17b1e440290ea57.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_a9863870f3e4b5374eda0587a2e00800.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a9863870f3e4b5374eda0587a2e00800.jpg not downloaded yet
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH83138> (referer: https://www.auto1.com/v1/car-details-view/LH83138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b1c0459237bf78e32f3f98519f3429d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_d02464ca0aaeb97737ea571b49ee9ec3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_d02464ca0aaeb97737ea571b49ee9ec3.jpg not downloaded yet
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ03674> (referer: https://www.auto1.com/v1/car-details-view/KZ03674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d919d50>
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_af70ace402519f87045d303d5b2e2482.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_af70ace402519f87045d303d5b2e2482.jpg saved to cache
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d91bb10>
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_d6ed1fdcef7c926718bf4c6798848536.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_d6ed1fdcef7c926718bf4c6798848536.jpg saved to cache
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e760390>
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_fa7ee939953857ac568ecf3bcc9c9cc9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_fa7ee939953857ac568ecf3bcc9c9cc9.jpg saved to cache
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dbdc1b0c873449393ff5f64e4abe7c41.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a96e7d88564141bdef8578a0c2c4aa38.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_b00d84d920e4bfa51fb03cdd3cbd82e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_b00d84d920e4bfa51fb03cdd3cbd82e0.jpg not downloaded yet
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a59d0>
2025-12-05 17:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_19e2b5bacb287f35231770e5509b4416.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_19e2b5bacb287f35231770e5509b4416.jpg saved to cache
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a6a10>
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_8805dff6bbf5f93a6210e8f590912774.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8805dff6bbf5f93a6210e8f590912774.jpg saved to cache
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_0f211209de379c373425c5ef5e31c7b7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_1fb3cbfb664a0ed286b679fb674f40f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_2aec991a239ec58c1f71e06d9e6dad61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_2aec991a239ec58c1f71e06d9e6dad61.jpg not downloaded yet
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f4722245df9099a65fbd4b0ddfc0b236.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_5df089d7a9a5cc052b0f360a7442ea14.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_04e2ffb992e43293b624596ead72d124.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_04e2ffb992e43293b624596ead72d124.jpg not downloaded yet
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY68664> (referer: https://www.auto1.com/v1/car-details-view/MY68664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d85cb50>
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_9f61617862ba88aca3e4d79151d2a353.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_9f61617862ba88aca3e4d79151d2a353.jpg saved to cache
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d93e850>
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_668573e5b81fbfb756f983af8ab48a68.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_668573e5b81fbfb756f983af8ab48a68.jpg saved to cache
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d978b10>
2025-12-05 17:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_319a12dcfe31b4e9e17b1e440290ea57.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_319a12dcfe31b4e9e17b1e440290ea57.jpg saved to cache
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee685553-824e-5c67-a2b3-4629f3024c4a with identifier: LH83138
2025-12-05 17:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee685553-824e-5c67-a2b3-4629f3024c4a with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee685553-824e-5c67-a2b3-4629f3024c4a with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee685553-824e-5c67-a2b3-4629f3024c4a, identifier: LH83138
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e80bf50>
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_b1c0459237bf78e32f3f98519f3429d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b1c0459237bf78e32f3f98519f3429d3.jpg saved to cache
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2992b98a-376c-54ff-aeb1-54b340dc397a with identifier: KZ03674
2025-12-05 17:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2992b98a-376c-54ff-aeb1-54b340dc397a with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2992b98a-376c-54ff-aeb1-54b340dc397a with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2992b98a-376c-54ff-aeb1-54b340dc397a, identifier: KZ03674
2025-12-05 17:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_de30d3d255b0cc0ca68f88bc0439a7fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_9b2a8a39913fc9d7bff56f8057d13723.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_9b2a8a39913fc9d7bff56f8057d13723.jpg not downloaded yet
2025-12-05 17:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee685553-824e-5c67-a2b3-4629f3024c4a with identifier: LH83138
2025-12-05 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee685553-824e-5c67-a2b3-4629f3024c4a with identifier: LH83138
2025-12-05 17:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee685553-824e-5c67-a2b3-4629f3024c4a with identifier: LH83138 to the API
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LH83138>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:06:39Z',
 'fuel_type': 'petrol',
 'id': 'ee685553-824e-5c67-a2b3-4629f3024c4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH83138',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 133529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV Motion 4WD',
 'transmission': 'automatic',
 'trim': 'Motion 4WD',
 'year': 2020}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH83138%27 HTTP/1.1" 200 None
2025-12-05 17:03:41 [auto1.es] INFO: Saving data for LH83138: {'auction_closing_time': 1765037199.0, 'created_time': 1762448711.783216, 'last_price_update_time': 1764954221.271376}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH83138') HTTP/1.1" 204 0
2025-12-05 17:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2992b98a-376c-54ff-aeb1-54b340dc397a with identifier: KZ03674
2025-12-05 17:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2992b98a-376c-54ff-aeb1-54b340dc397a with identifier: KZ03674
2025-12-05 17:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2992b98a-376c-54ff-aeb1-54b340dc397a with identifier: KZ03674 to the API
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ03674>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:11:21Z',
 'fuel_type': 'diesel',
 'id': '2992b98a-376c-54ff-aeb1-54b340dc397a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ03674',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 100765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ03674%27 HTTP/1.1" 200 None
2025-12-05 17:03:41 [auto1.es] INFO: Saving data for KZ03674: {'auction_closing_time': 1765037481.0, 'created_time': 1762509628.558374, 'last_price_update_time': 1764954221.58469}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ03674') HTTP/1.1" 204 0
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_17de2439370d702f3ab77870968357a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_f41440f6f603be2d15c9a70b15deb42e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f41440f6f603be2d15c9a70b15deb42e.jpg not downloaded yet
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_11f67538c7b3623464308763c7acceb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dcc14ed2e3f25b126b1324f19d3326c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d9603670ede4dbdfd5796cd2287329a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_e962559385a077cd4b57513785a5510e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_e962559385a077cd4b57513785a5510e.jpg not downloaded yet
2025-12-05 17:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da9add0>
2025-12-05 17:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd7%252Fd7d7e03585172d9eb42405b12746bf63%252Fpa%252FLB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg saved to cache
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78
2025-12-05 17:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78, skipping ID generation
2025-12-05 17:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 with scrape type 1
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 from tracking dictionaries
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 sending to next pipeline
2025-12-05 17:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78, identifier: LB21635
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ecf10>
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_dbdc1b0c873449393ff5f64e4abe7c41.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dbdc1b0c873449393ff5f64e4abe7c41.jpg saved to cache
2025-12-05 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6af250>
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_a96e7d88564141bdef8578a0c2c4aa38.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a96e7d88564141bdef8578a0c2c4aa38.jpg saved to cache
2025-12-05 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d848050>
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_0f211209de379c373425c5ef5e31c7b7.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_0f211209de379c373425c5ef5e31c7b7.jpg saved to cache
2025-12-05 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e1390>
2025-12-05 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_1fb3cbfb664a0ed286b679fb674f40f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_1fb3cbfb664a0ed286b679fb674f40f7.jpg saved to cache
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94a210>
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_f4722245df9099a65fbd4b0ddfc0b236.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f4722245df9099a65fbd4b0ddfc0b236.jpg saved to cache
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4dfb90>
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_5df089d7a9a5cc052b0f360a7442ea14.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_5df089d7a9a5cc052b0f360a7442ea14.jpg saved to cache
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 with identifier: MY68664
2025-12-05 17:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 with scrape type 2
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 with scrape type 2
2025-12-05 17:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52dd0e18-e096-5823-b9c7-c8e20f6d2e83, identifier: MY68664
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_9517df404bd4c381c55f0308f184f2ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_ec47e64b23ccbb6ff4dd8d1c62f8f41c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a9863870f3e4b5374eda0587a2e00800.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 with identifier: LB21635
2025-12-05 17:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 with identifier: LB21635
2025-12-05 17:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39a9b1fd-e0b4-51f3-b752-9b59c44ddb78 with identifier: LB21635 to the API
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:51:32Z',
 'fuel_type': 'diesel',
 'id': '39a9b1fd-e0b4-51f3-b752-9b59c44ddb78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB21635',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 94740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_94efcc1c03fdc0f2ccf626fe304949ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_204aec709663925d9328cb410e2a3916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8805dff6bbf5f93a6210e8f590912774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_488fe8eccbfcd8e52bc551e747492ad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_a867154c7a517ccba5fdb3be6a80a1b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_8ff10fd893ed487a8dcfda6b79998588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_d6ed1fdcef7c926718bf4c6798848536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_6c3a2f6fd00e35b486cc28362d0d4922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_370d2720129cc809a891a9af067fba14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_af70ace402519f87045d303d5b2e2482.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ccad7cb67498676a41ac4d557b77878b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_ba792640d5c7b520f24bed9b9185f9f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a9b1fd-e0b4-51f3-b752-9b59c44ddb78/39a9b1fd-e0b4-51f3-b752-9b59c44ddb78_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d7/d7d7e03585172d9eb42405b12746bf63/pa/LB21635_9f61617862ba88aca3e4d79151d2a353.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Drive",
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2023}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB21635%27 HTTP/1.1" 200 None
2025-12-05 17:03:44 [auto1.es] INFO: Saving data for LB21635: {'created_time': 1764954224.15328, 'last_price_update_time': 1764954224.15329, 'auction_closing_time': 1765039892.0}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LB21635') HTTP/1.1" 204 0
2025-12-05 17:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 with identifier: MY68664
2025-12-05 17:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 with identifier: MY68664
2025-12-05 17:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker' containing 'dokker'
2025-12-05 17:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 spider: auto1.es
2025-12-05 17:03:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 52dd0e18-e096-5823-b9c7-c8e20f6d2e83 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker' containing 'dokker'
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:53:59Z',
 'fuel_type': 'diesel',
 'id': '52dd0e18-e096-5823-b9c7-c8e20f6d2e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY68664',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 121366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Dokker 1.5 dCi Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY68664%27 HTTP/1.1" 200 None
2025-12-05 17:03:44 [auto1.es] INFO: Saving data for MY68664: {'auction_closing_time': 1765040039.0, 'created_time': 1764090318.098858, 'last_price_update_time': 1764954224.398433}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY68664') HTTP/1.1" 204 0
2025-12-05 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dd8fa5099046fd333f646495b4e0ec59.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_8deb763d06e38304e2cd4dc602c2e58a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8deb763d06e38304e2cd4dc602c2e58a.jpg not downloaded yet
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d4a10>
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_de30d3d255b0cc0ca68f88bc0439a7fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_de30d3d255b0cc0ca68f88bc0439a7fa.jpg saved to cache
2025-12-05 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66913d1e50>
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_17de2439370d702f3ab77870968357a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_17de2439370d702f3ab77870968357a5.jpg saved to cache
2025-12-05 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dad3d50>
2025-12-05 17:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_11f67538c7b3623464308763c7acceb1.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_11f67538c7b3623464308763c7acceb1.jpg saved to cache
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66913d0750>
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_dcc14ed2e3f25b126b1324f19d3326c8.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dcc14ed2e3f25b126b1324f19d3326c8.jpg saved to cache
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e46b250>
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Ff2%252Ff7f2c820857ab6feb5415208dd4b98f3%252Fpa%252FKX32813_d9603670ede4dbdfd5796cd2287329a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d9603670ede4dbdfd5796cd2287329a5.jpg saved to cache
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab
2025-12-05 17:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab, skipping ID generation
2025-12-05 17:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab with scrape type 1
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab from tracking dictionaries
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab sending to next pipeline
2025-12-05 17:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab, identifier: KX32813
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9b359a1b50109f2793628dd2129bc16d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_2aec991a239ec58c1f71e06d9e6dad61.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_b00d84d920e4bfa51fb03cdd3cbd82e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_d02464ca0aaeb97737ea571b49ee9ec3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_75778ad4e673e774233eefebd605a32e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_b76e7e6730e7ac0d7be42f3c22bcfc6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b76e7e6730e7ac0d7be42f3c22bcfc6c.jpg not downloaded yet
2025-12-05 17:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab with identifier: KX32813
2025-12-05 17:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab with identifier: KX32813
2025-12-05 17:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151877 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151877
2025-12-05 17:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab spider: auto1.es
2025-12-05 17:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8bba69f8-57b4-5ab9-b6c5-e0c8f02accab due to rule: high_mileage_for_country.json, error: 151877 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151877
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2025-12-06T16:40:25Z',
 'fuel_type': 'diesel',
 'id': '8bba69f8-57b4-5ab9-b6c5-e0c8f02accab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX32813',
 'listing': 'auction',
 'location': 'ES, Ferrol',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 151877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_eefd2666a0b1658501b9db51e5f0e6e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ec300fa699c1de83dd10d029d591a3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_419c8e0647b1d39a8c26a8136a679c66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_17de2439370d702f3ab77870968357a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d9603670ede4dbdfd5796cd2287329a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_6ad3430fd7168277fe4867d29f297f65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_ffc7507b671973866b04c65c04aab8ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0395bf776f25054220a6ffb294fb838c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_3f9e9b8b43a07180b469049d20ee1c33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_d187e306a5bc2796ae705531e1f9279f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_e00cbb98175b7052e061b64d0197964f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5144468e6630a2115d295674bae6d465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_0c955ccc8f44c9d69f6b83309572da82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_5b92751a4d2ba4231b95f14b28570572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_2589d47e72ea5afc7dcef2f7dab55582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bba69f8-57b4-5ab9-b6c5-e0c8f02accab/8bba69f8-57b4-5ab9-b6c5-e0c8f02accab_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/f2/f7f2c820857ab6feb5415208dd4b98f3/pa/KX32813_fa7ee939953857ac568ecf3bcc9c9cc9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX32813%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [auto1.es] INFO: Saving data for KX32813: {'created_time': 1764954226.02478, 'last_price_update_time': 1764954226.02479, 'auction_closing_time': 1765039225.0}
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX32813') HTTP/1.1" 204 0
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d955150>
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_9517df404bd4c381c55f0308f184f2ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_9517df404bd4c381c55f0308f184f2ec.jpg saved to cache
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e8254d0>
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_ec47e64b23ccbb6ff4dd8d1c62f8f41c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_ec47e64b23ccbb6ff4dd8d1c62f8f41c.jpg saved to cache
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a1d50>
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_a9863870f3e4b5374eda0587a2e00800.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a9863870f3e4b5374eda0587a2e00800.jpg saved to cache
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_680e6ad7d61b6e46ab815535ade92d3f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e502990>
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_dd8fa5099046fd333f646495b4e0ec59.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dd8fa5099046fd333f646495b4e0ec59.jpg saved to cache
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dbfd1c392e2f0843baa2145bf8fb943c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_f3abee73fa0ed501063ba560927db1b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_f3abee73fa0ed501063ba560927db1b6.jpg not downloaded yet
2025-12-05 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_9b2a8a39913fc9d7bff56f8057d13723.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94b110>
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_9b359a1b50109f2793628dd2129bc16d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9b359a1b50109f2793628dd2129bc16d.jpg saved to cache
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6ada10>
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_2aec991a239ec58c1f71e06d9e6dad61.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_2aec991a239ec58c1f71e06d9e6dad61.jpg saved to cache
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da82d90>
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_b00d84d920e4bfa51fb03cdd3cbd82e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_b00d84d920e4bfa51fb03cdd3cbd82e0.jpg saved to cache
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e627010>
2025-12-05 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_d02464ca0aaeb97737ea571b49ee9ec3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_d02464ca0aaeb97737ea571b49ee9ec3.jpg saved to cache
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e511610>
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_75778ad4e673e774233eefebd605a32e.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_75778ad4e673e774233eefebd605a32e.jpg saved to cache
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a2c90>
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F6c%252F6d6c12874015f224222643ee9f61ad3f%252Fpa%252FTW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg saved to cache
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53969ea5-c215-5800-bbde-17b5afb1445c
2025-12-05 17:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53969ea5-c215-5800-bbde-17b5afb1445c, skipping ID generation
2025-12-05 17:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53969ea5-c215-5800-bbde-17b5afb1445c with scrape type 1
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 53969ea5-c215-5800-bbde-17b5afb1445c from tracking dictionaries
2025-12-05 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53969ea5-c215-5800-bbde-17b5afb1445c sending to next pipeline
2025-12-05 17:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53969ea5-c215-5800-bbde-17b5afb1445c, identifier: TW44451
2025-12-05 17:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_51480f6a5054367c8fd75a6ca83d6209.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f41440f6f603be2d15c9a70b15deb42e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_573e826b0deeddb44955885a7f818e16.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_9d7b4f3f3f0964112b9d5ff8883ec719.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_04e2ffb992e43293b624596ead72d124.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53969ea5-c215-5800-bbde-17b5afb1445c with identifier: TW44451
2025-12-05 17:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53969ea5-c215-5800-bbde-17b5afb1445c with identifier: TW44451
2025-12-05 17:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53969ea5-c215-5800-bbde-17b5afb1445c with identifier: TW44451 to the API
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:17:10Z',
 'fuel_type': 'diesel',
 'id': '53969ea5-c215-5800-bbde-17b5afb1445c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44451',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 98912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_12d9a9e0e81f9de815abdc48b1f3eb9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_a219a77cfa8a03ea8d29f5f8f4b9c5b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c2c5d9f15c596c4eddeb98e921fe76b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_9517df404bd4c381c55f0308f184f2ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ba1607b8be74c7a8abe0d0240db71b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_492e07762a11a217c91f054a34f8bbda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_e3f31395f0630c2b206159a042d3bec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_fc41a0a711a7f48d817c72c652018b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ec38c7fe548a09a8d633873049e0b2c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_1fb3cbfb664a0ed286b679fb674f40f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_ddf6bcedc5cff6e32ad8b665b7ee748c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_64477b87a7286a2e935e1841c65b66db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53969ea5-c215-5800-bbde-17b5afb1445c/53969ea5-c215-5800-bbde-17b5afb1445c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/6c/6d6c12874015f224222643ee9f61ad3f/pa/TW44451_c52a464e898d02c36c757e1ed52a3802.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Drive",
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2023}
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW44451%27 HTTP/1.1" 200 None
2025-12-05 17:03:50 [auto1.es] INFO: Saving data for TW44451: {'created_time': 1764954230.206478, 'last_price_update_time': 1764954230.206487, 'auction_closing_time': 1765037830.0}
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW44451') HTTP/1.1" 204 0
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6acc50>
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_680e6ad7d61b6e46ab815535ade92d3f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_680e6ad7d61b6e46ab815535ade92d3f.jpg saved to cache
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_e962559385a077cd4b57513785a5510e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8deb763d06e38304e2cd4dc602c2e58a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_16146fe5f2e208ff2efa0beadefde03d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d956c10>
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_dbfd1c392e2f0843baa2145bf8fb943c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dbfd1c392e2f0843baa2145bf8fb943c.jpg saved to cache
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9577d0>
2025-12-05 17:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_9b2a8a39913fc9d7bff56f8057d13723.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_9b2a8a39913fc9d7bff56f8057d13723.jpg saved to cache
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e480d10>
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_51480f6a5054367c8fd75a6ca83d6209.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_51480f6a5054367c8fd75a6ca83d6209.jpg saved to cache
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e607950>
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_f41440f6f603be2d15c9a70b15deb42e.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f41440f6f603be2d15c9a70b15deb42e.jpg saved to cache
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94aa90>
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_573e826b0deeddb44955885a7f818e16.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_573e826b0deeddb44955885a7f818e16.jpg saved to cache
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e604cd0>
2025-12-05 17:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_9d7b4f3f3f0964112b9d5ff8883ec719.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_9d7b4f3f3f0964112b9d5ff8883ec719.jpg saved to cache
2025-12-05 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da83f90>
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ffd%252F7efd5ecee4e8838862f87049a97ff3de%252Fpa%252FTJ01598_04e2ffb992e43293b624596ead72d124.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_04e2ffb992e43293b624596ead72d124.jpg saved to cache
2025-12-05 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db
2025-12-05 17:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db, skipping ID generation
2025-12-05 17:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db with scrape type 1
2025-12-05 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db from tracking dictionaries
2025-12-05 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db sending to next pipeline
2025-12-05 17:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db, identifier: TJ01598
2025-12-05 17:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db with identifier: TJ01598
2025-12-05 17:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db with identifier: TJ01598
2025-12-05 17:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3050ce7c-7845-5bd1-bfe0-7d5e1264f7db with identifier: TJ01598 to the API
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_04e2ffb992e43293b624596ead72d124.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-06T16:43:39Z',
 'fuel_type': 'petrol',
 'id': '3050ce7c-7845-5bd1-bfe0-7d5e1264f7db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ01598',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '4er',
 'odometer': 20049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_cdc09868b63f8a6340988b9289c2ed90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c65e702303ce326709081f4776ac71b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_19e2b5bacb287f35231770e5509b4416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_4e863bfa369ae0ff8c43d04257e09f53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_3dd09e431ef35bc238473e9d98817e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_068d6744353fa73a465db5b5b705982e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_11e6489304960a488a56ac54d9ea05bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_975cb64f04e22cdcdf1dcf324bf045c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_0704f6cbbeaf97fe0e7f16f311c7ec74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_7ab4004998696b16b555cb4209670915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_c588fda91c3bdd443ae99976ecc8be2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dbdc1b0c873449393ff5f64e4abe7c41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_319a12dcfe31b4e9e17b1e440290ea57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a96e7d88564141bdef8578a0c2c4aa38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f4722245df9099a65fbd4b0ddfc0b236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_dcc14ed2e3f25b126b1324f19d3326c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_a9863870f3e4b5374eda0587a2e00800.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_b00d84d920e4bfa51fb03cdd3cbd82e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_04e2ffb992e43293b624596ead72d124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3050ce7c-7845-5bd1-bfe0-7d5e1264f7db/3050ce7c-7845-5bd1-bfe0-7d5e1264f7db_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/fd/7efd5ecee4e8838862f87049a97ff3de/pa/TJ01598_f41440f6f603be2d15c9a70b15deb42e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er 430i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ01598%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [auto1.es] INFO: Saving data for TJ01598: {'created_time': 1764954233.648737, 'last_price_update_time': 1764954233.648749, 'auction_closing_time': 1765039419.0}
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ01598') HTTP/1.1" 204 0
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b76e7e6730e7ac0d7be42f3c22bcfc6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e7837394b77b2c1465fb0da5fe241ad2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_b29629b75a3a77072f1da4920e04a72b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_4182e86c77988b9bf9ea0ad4e2a8b5f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8ce7265ce8572b86e19ccbf747533fab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_2aafaf433c07bed1c35f353b8e214636.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_94861ecf7f04b7d52ca7b67b149af81d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8d31d0>
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_e962559385a077cd4b57513785a5510e.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_e962559385a077cd4b57513785a5510e.jpg saved to cache
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e634410>
2025-12-05 17:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_8deb763d06e38304e2cd4dc602c2e58a.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8deb763d06e38304e2cd4dc602c2e58a.jpg saved to cache
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e577a90>
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_16146fe5f2e208ff2efa0beadefde03d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_16146fe5f2e208ff2efa0beadefde03d.jpg saved to cache
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_0afb81cf9b3f27590b00acc0bfb59d81.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4eed10>
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_b76e7e6730e7ac0d7be42f3c22bcfc6c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b76e7e6730e7ac0d7be42f3c22bcfc6c.jpg saved to cache
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f92d0>
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_e7837394b77b2c1465fb0da5fe241ad2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e7837394b77b2c1465fb0da5fe241ad2.jpg saved to cache
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db856d0>
2025-12-05 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_b29629b75a3a77072f1da4920e04a72b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_b29629b75a3a77072f1da4920e04a72b.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f8bd0>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_4182e86c77988b9bf9ea0ad4e2a8b5f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_4182e86c77988b9bf9ea0ad4e2a8b5f5.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7ea4d0>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_8ce7265ce8572b86e19ccbf747533fab.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8ce7265ce8572b86e19ccbf747533fab.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbba510>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_2aafaf433c07bed1c35f353b8e214636.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_2aafaf433c07bed1c35f353b8e214636.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e835b10>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_94861ecf7f04b7d52ca7b67b149af81d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_94861ecf7f04b7d52ca7b67b149af81d.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_66864afd42ad346b187f3930e105af69.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_562b8f7a8f85450c122b4e853a544015.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_f3abee73fa0ed501063ba560927db1b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9c8ef37680686ee2a7c532ec7474931f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8f9b10>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_0afb81cf9b3f27590b00acc0bfb59d81.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_0afb81cf9b3f27590b00acc0bfb59d81.jpg saved to cache
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e755e90>
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_66864afd42ad346b187f3930e105af69.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_66864afd42ad346b187f3930e105af69.jpg saved to cache
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e795650>
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa2%252Fb2a2b8346c9211eb4f9af2733342cb6c%252Fpa%252FZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg saved to cache
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e781267d-4c3d-5ea3-a8d8-edc060a853e8
2025-12-05 17:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e781267d-4c3d-5ea3-a8d8-edc060a853e8, skipping ID generation
2025-12-05 17:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e781267d-4c3d-5ea3-a8d8-edc060a853e8 with scrape type 1
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e781267d-4c3d-5ea3-a8d8-edc060a853e8 from tracking dictionaries
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e781267d-4c3d-5ea3-a8d8-edc060a853e8 sending to next pipeline
2025-12-05 17:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e781267d-4c3d-5ea3-a8d8-edc060a853e8, identifier: ZT88716
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f9490>
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_562b8f7a8f85450c122b4e853a544015.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_562b8f7a8f85450c122b4e853a544015.jpg saved to cache
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8fbe50>
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F79%252F9d79cf51ccdf29ccbc58de3e3600471d%252Fpa%252FVS88612_f3abee73fa0ed501063ba560927db1b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_f3abee73fa0ed501063ba560927db1b6.jpg saved to cache
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bfa84858-4184-5054-995d-27a1f3823dfe
2025-12-05 17:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfa84858-4184-5054-995d-27a1f3823dfe, skipping ID generation
2025-12-05 17:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa84858-4184-5054-995d-27a1f3823dfe with scrape type 1
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bfa84858-4184-5054-995d-27a1f3823dfe from tracking dictionaries
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfa84858-4184-5054-995d-27a1f3823dfe sending to next pipeline
2025-12-05 17:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfa84858-4184-5054-995d-27a1f3823dfe, identifier: VS88612
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e92a410>
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F96%252Ff7969a857475cddb2af60a4cf5265e78%252Fpa%252FDH01871_9c8ef37680686ee2a7c532ec7474931f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9c8ef37680686ee2a7c532ec7474931f.jpg saved to cache
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057
2025-12-05 17:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 039bdf98-c022-51c4-aa9f-a8c8b0b57057, skipping ID generation
2025-12-05 17:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057 with scrape type 1
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 039bdf98-c022-51c4-aa9f-a8c8b0b57057 from tracking dictionaries
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 039bdf98-c022-51c4-aa9f-a8c8b0b57057 sending to next pipeline
2025-12-05 17:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 039bdf98-c022-51c4-aa9f-a8c8b0b57057, identifier: DH01871
2025-12-05 17:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e781267d-4c3d-5ea3-a8d8-edc060a853e8 with identifier: ZT88716
2025-12-05 17:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e781267d-4c3d-5ea3-a8d8-edc060a853e8 with identifier: ZT88716
2025-12-05 17:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e781267d-4c3d-5ea3-a8d8-edc060a853e8 with identifier: ZT88716 to the API
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:35:56Z',
 'fuel_type': 'diesel',
 'id': 'e781267d-4c3d-5ea3-a8d8-edc060a853e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT88716',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 102332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e95580c8f498ec0bf25679435eb39ec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_b29629b75a3a77072f1da4920e04a72b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_e7837394b77b2c1465fb0da5fe241ad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_a146a323185ca9d763fe0a3b92e9ec95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_2aafaf433c07bed1c35f353b8e214636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_9d7b4f3f3f0964112b9d5ff8883ec719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_573e826b0deeddb44955885a7f818e16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_7476712c1002efb5039be48a895eb0aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_680e6ad7d61b6e46ab815535ade92d3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_75778ad4e673e774233eefebd605a32e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_432df69a8171892d37f33439400ef7bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_d2504d1f3d7a466a7af5d789c8ecd8ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e781267d-4c3d-5ea3-a8d8-edc060a853e8/e781267d-4c3d-5ea3-a8d8-edc060a853e8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a2/b2a2b8346c9211eb4f9af2733342cb6c/pa/ZT88716_aeaf549653f05f41b25098968f06a827.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Drive",
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2023}
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT88716%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [auto1.es] INFO: Saving data for ZT88716: {'created_time': 1764954238.17845, 'last_price_update_time': 1764954238.178462, 'auction_closing_time': 1765038956.0}
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT88716') HTTP/1.1" 204 0
2025-12-05 17:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfa84858-4184-5054-995d-27a1f3823dfe with identifier: VS88612
2025-12-05 17:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfa84858-4184-5054-995d-27a1f3823dfe with identifier: VS88612
2025-12-05 17:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bfa84858-4184-5054-995d-27a1f3823dfe with identifier: VS88612 to the API
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_f3abee73fa0ed501063ba560927db1b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2025-12-06T16:10:00Z',
 'fuel_type': 'petrol',
 'id': 'bfa84858-4184-5054-995d-27a1f3823dfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS88612',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 69974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_7cdf897d2bfb7192ae6506397dfa12bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_a8c72402de5ec0192099df84cf917bee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8f537e473e9be67e5997b26b63a7bc15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_279968f1dd82b3ca66b55cd9583fb529.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_668573e5b81fbfb756f983af8ab48a68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b1c0459237bf78e32f3f98519f3429d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_0f211209de379c373425c5ef5e31c7b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_de30d3d255b0cc0ca68f88bc0439a7fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_ec47e64b23ccbb6ff4dd8d1c62f8f41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_d02464ca0aaeb97737ea571b49ee9ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_2aec991a239ec58c1f71e06d9e6dad61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_9b2a8a39913fc9d7bff56f8057d13723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_e962559385a077cd4b57513785a5510e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_8deb763d06e38304e2cd4dc602c2e58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_b76e7e6730e7ac0d7be42f3c22bcfc6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfa84858-4184-5054-995d-27a1f3823dfe/bfa84858-4184-5054-995d-27a1f3823dfe_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/79/9d79cf51ccdf29ccbc58de3e3600471d/pa/VS88612_f3abee73fa0ed501063ba560927db1b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 40i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VS88612%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [auto1.es] INFO: Saving data for VS88612: {'created_time': 1764954238.52549, 'last_price_update_time': 1764954238.5255, 'auction_closing_time': 1765037400.0}
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VS88612') HTTP/1.1" 204 0
2025-12-05 17:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 039bdf98-c022-51c4-aa9f-a8c8b0b57057 with identifier: DH01871
2025-12-05 17:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 039bdf98-c022-51c4-aa9f-a8c8b0b57057 with identifier: DH01871
2025-12-05 17:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 039bdf98-c022-51c4-aa9f-a8c8b0b57057 with identifier: DH01871 to the API
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9c8ef37680686ee2a7c532ec7474931f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:27:47Z',
 'fuel_type': 'petrol',
 'id': '039bdf98-c022-51c4-aa9f-a8c8b0b57057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH01871',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 38470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9c8ef37680686ee2a7c532ec7474931f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_562b8f7a8f85450c122b4e853a544015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_66864afd42ad346b187f3930e105af69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_0afb81cf9b3f27590b00acc0bfb59d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_94861ecf7f04b7d52ca7b67b149af81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_4182e86c77988b9bf9ea0ad4e2a8b5f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8ce7265ce8572b86e19ccbf747533fab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_16146fe5f2e208ff2efa0beadefde03d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_51480f6a5054367c8fd75a6ca83d6209.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_32255c5ba5d621f13c0d5c4b2f3e14c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dbfd1c392e2f0843baa2145bf8fb943c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_9b359a1b50109f2793628dd2129bc16d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_dd8fa5099046fd333f646495b4e0ec59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_11f67538c7b3623464308763c7acceb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_84c240e15d02b510259a737abc92f4a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_a13bfbc8a35e1cf7f1fb37431473e09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_8f9df5cba2ffe8b8a4be9679a39d5b2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_5df089d7a9a5cc052b0f360a7442ea14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039bdf98-c022-51c4-aa9f-a8c8b0b57057/039bdf98-c022-51c4-aa9f-a8c8b0b57057_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/96/f7969a857475cddb2af60a4cf5265e78/pa/DH01871_47a181c6af58e40362c91e3473eaa80d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH01871%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [auto1.es] INFO: Saving data for DH01871: {'created_time': 1764954238.89089, 'last_price_update_time': 1764954238.890899, 'auction_closing_time': 1765038467.0}
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH01871') HTTP/1.1" 204 0
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM12264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN43784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN58653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV49987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS63080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR23839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA10352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH29076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG10760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL80540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT21379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA90839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF19064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG84496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT53297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL11058> (referer: https://www.auto1.com/v1/car-details-view/HL11058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b41f98-6c22-599e-a296-7b83e84a5e7a with identifier: HL11058
2025-12-05 17:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b41f98-6c22-599e-a296-7b83e84a5e7a with scrape type 2
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09b41f98-6c22-599e-a296-7b83e84a5e7a with scrape type 2
2025-12-05 17:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09b41f98-6c22-599e-a296-7b83e84a5e7a, identifier: HL11058
2025-12-05 17:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09b41f98-6c22-599e-a296-7b83e84a5e7a with identifier: HL11058
2025-12-05 17:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09b41f98-6c22-599e-a296-7b83e84a5e7a with identifier: HL11058
2025-12-05 17:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 09b41f98-6c22-599e-a296-7b83e84a5e7a with identifier: HL11058 to the API
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL11058>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 165,
 'expiration_date': '2025-12-06T16:00:32Z',
 'fuel_type': 'petrol',
 'id': '09b41f98-6c22-599e-a296-7b83e84a5e7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL11058',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 58217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo Ultimate Exclusive',
 'transmission': 'automatic',
 'trim': 'Ultimate Exclusive',
 'year': 2020}
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL11058%27 HTTP/1.1" 200 None
2025-12-05 17:04:00 [auto1.es] INFO: Saving data for HL11058: {'auction_closing_time': 1765036832.0, 'created_time': 1761042813.658684, 'last_price_update_time': 1764954240.474163}
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL11058') HTTP/1.1" 204 0
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ28079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB70012> (referer: https://www.auto1.com/v1/car-details-view/TB70012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV28926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d with identifier: TB70012
2025-12-05 17:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d with scrape type 2
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d with scrape type 2
2025-12-05 17:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d, identifier: TB70012
2025-12-05 17:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d with identifier: TB70012
2025-12-05 17:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d with identifier: TB70012
2025-12-05 17:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d with identifier: TB70012 to the API
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB70012>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:01:02Z',
 'fuel_type': 'diesel',
 'id': '9eaeb9fc-9e9d-53ef-a9db-ff7dea64952d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB70012',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 67377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB70012%27 HTTP/1.1" 200 None
2025-12-05 17:04:01 [auto1.es] INFO: Saving data for TB70012: {'auction_closing_time': 1765036862.0, 'created_time': 1762347480.137237, 'last_price_update_time': 1764954241.253359}
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB70012') HTTP/1.1" 204 0
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP81684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU54513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA13852/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE24471> (referer: https://www.auto1.com/v1/car-details-view/HE24471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP61591> (referer: https://www.auto1.com/v1/car-details-view/BP61591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eca1ef5-082e-534a-8b34-f55681bebc74 with identifier: HE24471
2025-12-05 17:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eca1ef5-082e-534a-8b34-f55681bebc74 with scrape type 2
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eca1ef5-082e-534a-8b34-f55681bebc74 with scrape type 2
2025-12-05 17:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6eca1ef5-082e-534a-8b34-f55681bebc74, identifier: HE24471
2025-12-05 17:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 068f9d8b-0571-5d93-acd1-15a7eae96067 with identifier: BP61591
2025-12-05 17:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 068f9d8b-0571-5d93-acd1-15a7eae96067 with scrape type 2
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 068f9d8b-0571-5d93-acd1-15a7eae96067 with scrape type 2
2025-12-05 17:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 068f9d8b-0571-5d93-acd1-15a7eae96067, identifier: BP61591
2025-12-05 17:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6eca1ef5-082e-534a-8b34-f55681bebc74 with identifier: HE24471
2025-12-05 17:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6eca1ef5-082e-534a-8b34-f55681bebc74 with identifier: HE24471
2025-12-05 17:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6eca1ef5-082e-534a-8b34-f55681bebc74 with identifier: HE24471 to the API
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE24471>
{'auction_title': '',
 'c_o_2_emission_value': 65,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:55:07Z',
 'fuel_type': 'hybrid',
 'id': '6eca1ef5-082e-534a-8b34-f55681bebc74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE24471',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 112878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Feel Pack',
 'transmission': 'automatic',
 'trim': 'Feel Pack',
 'year': 2021}
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE24471%27 HTTP/1.1" 200 None
2025-12-05 17:04:02 [auto1.es] INFO: Saving data for HE24471: {'auction_closing_time': 1765040107.0, 'created_time': 1762967070.513442, 'last_price_update_time': 1764954242.033041}
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HE24471') HTTP/1.1" 204 0
2025-12-05 17:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 068f9d8b-0571-5d93-acd1-15a7eae96067 with identifier: BP61591
2025-12-05 17:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 068f9d8b-0571-5d93-acd1-15a7eae96067 with identifier: BP61591
2025-12-05 17:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 068f9d8b-0571-5d93-acd1-15a7eae96067 with identifier: BP61591 to the API
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP61591>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:27:36Z',
 'fuel_type': 'petrol',
 'id': '068f9d8b-0571-5d93-acd1-15a7eae96067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP61591',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 34326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2024}
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2025-12-05 17:04:02 [auto1.es] INFO: Saving data for BP61591: {'auction_closing_time': 1765038456.0, 'created_time': 1763658100.169648, 'last_price_update_time': 1764954242.383386}
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP61591') HTTP/1.1" 204 0
2025-12-05 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR23839> (referer: https://www.auto1.com/v1/car-details-view/FR23839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA10352> (referer: https://www.auto1.com/v1/car-details-view/GA10352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70090a0-bb7b-584e-9f27-6abb3cc39014 with identifier: FR23839
2025-12-05 17:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70090a0-bb7b-584e-9f27-6abb3cc39014 with scrape type 2
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70090a0-bb7b-584e-9f27-6abb3cc39014 with scrape type 2
2025-12-05 17:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c70090a0-bb7b-584e-9f27-6abb3cc39014, identifier: FR23839
2025-12-05 17:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c70090a0-bb7b-584e-9f27-6abb3cc39014 with identifier: FR23839
2025-12-05 17:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c70090a0-bb7b-584e-9f27-6abb3cc39014 with identifier: FR23839
2025-12-05 17:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c70090a0-bb7b-584e-9f27-6abb3cc39014 with identifier: FR23839 to the API
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FR23839>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:30:57Z',
 'fuel_type': 'diesel',
 'id': 'c70090a0-bb7b-584e-9f27-6abb3cc39014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR23839',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 120840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR23839%27 HTTP/1.1" 200 None
2025-12-05 17:04:02 [auto1.es] INFO: Saving data for FR23839: {'auction_closing_time': 1765038657.0, 'created_time': 1764003690.185911, 'last_price_update_time': 1764954242.924494}
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FR23839') HTTP/1.1" 204 0
2025-12-05 17:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d676824-5db9-59e3-8238-ebd846a262bd with identifier: GA10352
2025-12-05 17:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d676824-5db9-59e3-8238-ebd846a262bd with scrape type 1
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7d676824-5db9-59e3-8238-ebd846a262bd
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_c8ef031b77c4b2052c49234d2f483df3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_c8ef031b77c4b2052c49234d2f483df3.jpg already downloaded
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_97940874ca236b9909247f9a9c3e9bf0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_97940874ca236b9909247f9a9c3e9bf0.jpg already downloaded
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_23e57c381a2e78ef513ae37891cc8e44.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_23e57c381a2e78ef513ae37891cc8e44.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_09ebd8b57fd6e9fb87cb73175792f26a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_09ebd8b57fd6e9fb87cb73175792f26a.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_5c07b2a0ee3e0b104caee69ae1e955dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_5c07b2a0ee3e0b104caee69ae1e955dc.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_f162b6136cc4984ee32ad20c2c18ba4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_f162b6136cc4984ee32ad20c2c18ba4d.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_e88954131926026dd2f85f795ea934f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e88954131926026dd2f85f795ea934f2.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_e353e43451b22090ff607d4d3f2c5e85.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e353e43451b22090ff607d4d3f2c5e85.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_646c275bd64cd05f57bbcec949516ded.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_646c275bd64cd05f57bbcec949516ded.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_e15cd05579b7f53eeb98745ebe573d42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e15cd05579b7f53eeb98745ebe573d42.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_d23ea4df4ef22058357a92ddd8892f3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_d23ea4df4ef22058357a92ddd8892f3a.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_84178032ca01904d724ce77bc37888bf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_84178032ca01904d724ce77bc37888bf.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_88c54dc0e7615e0401326001f75e1418.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_88c54dc0e7615e0401326001f75e1418.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_0107cd6e581f007fe823062026cf5a00.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_0107cd6e581f007fe823062026cf5a00.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_9bad0ef64d05f2e5984c0b953a480cf8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_9bad0ef64d05f2e5984c0b953a480cf8.jpg already downloaded
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F91%252F31914d8318a2deeee5b965bcb851a420%252Fpa%252FGA10352_37944be9844ffe709408e63d5f6f739a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_37944be9844ffe709408e63d5f6f739a.jpg already downloaded
2025-12-05 17:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d676824-5db9-59e3-8238-ebd846a262bd, identifier: GA10352
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH29076> (referer: https://www.auto1.com/v1/car-details-view/KH29076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d676824-5db9-59e3-8238-ebd846a262bd with identifier: GA10352
2025-12-05 17:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d676824-5db9-59e3-8238-ebd846a262bd with identifier: GA10352
2025-12-05 17:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7d676824-5db9-59e3-8238-ebd846a262bd spider: auto1.es
2025-12-05 17:04:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7d676824-5db9-59e3-8238-ebd846a262bd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:33:56Z',
 'fuel_type': 'diesel',
 'id': '7d676824-5db9-59e3-8238-ebd846a262bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA10352',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 112881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_c8ef031b77c4b2052c49234d2f483df3.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_97940874ca236b9909247f9a9c3e9bf0.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_23e57c381a2e78ef513ae37891cc8e44.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_09ebd8b57fd6e9fb87cb73175792f26a.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_5c07b2a0ee3e0b104caee69ae1e955dc.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_f162b6136cc4984ee32ad20c2c18ba4d.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e88954131926026dd2f85f795ea934f2.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e353e43451b22090ff607d4d3f2c5e85.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_646c275bd64cd05f57bbcec949516ded.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e15cd05579b7f53eeb98745ebe573d42.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_d23ea4df4ef22058357a92ddd8892f3a.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_84178032ca01904d724ce77bc37888bf.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_88c54dc0e7615e0401326001f75e1418.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_0107cd6e581f007fe823062026cf5a00.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_9bad0ef64d05f2e5984c0b953a480cf8.jpg',
                'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_37944be9844ffe709408e63d5f6f739a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_c8ef031b77c4b2052c49234d2f483df3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_97940874ca236b9909247f9a9c3e9bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_23e57c381a2e78ef513ae37891cc8e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_09ebd8b57fd6e9fb87cb73175792f26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_5c07b2a0ee3e0b104caee69ae1e955dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_f162b6136cc4984ee32ad20c2c18ba4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e88954131926026dd2f85f795ea934f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e353e43451b22090ff607d4d3f2c5e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_646c275bd64cd05f57bbcec949516ded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_e15cd05579b7f53eeb98745ebe573d42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_d23ea4df4ef22058357a92ddd8892f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_84178032ca01904d724ce77bc37888bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_88c54dc0e7615e0401326001f75e1418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_0107cd6e581f007fe823062026cf5a00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_9bad0ef64d05f2e5984c0b953a480cf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d676824-5db9-59e3-8238-ebd846a262bd/7d676824-5db9-59e3-8238-ebd846a262bd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/91/31914d8318a2deeee5b965bcb851a420/pa/GA10352_37944be9844ffe709408e63d5f6f739a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
 'transmission': 'manual',
 'trim': 'GT L1',
 'year': 2021}
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA10352%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [auto1.es] INFO: Saving data for GA10352: {'created_time': 1764954243.569452, 'last_price_update_time': 1764954243.569468, 'auction_closing_time': 1765038836.0}
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GA10352') HTTP/1.1" 204 0
2025-12-05 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG10760> (referer: https://www.auto1.com/v1/car-details-view/EG10760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea100ac-4dfe-588d-bfed-a34c81244dee with identifier: KH29076
2025-12-05 17:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea100ac-4dfe-588d-bfed-a34c81244dee with scrape type 2
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea100ac-4dfe-588d-bfed-a34c81244dee with scrape type 2
2025-12-05 17:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ea100ac-4dfe-588d-bfed-a34c81244dee, identifier: KH29076
2025-12-05 17:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ea100ac-4dfe-588d-bfed-a34c81244dee with identifier: KH29076
2025-12-05 17:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ea100ac-4dfe-588d-bfed-a34c81244dee with identifier: KH29076
2025-12-05 17:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ea100ac-4dfe-588d-bfed-a34c81244dee with identifier: KH29076 to the API
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH29076>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:15:34Z',
 'fuel_type': 'diesel',
 'id': '7ea100ac-4dfe-588d-bfed-a34c81244dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH29076',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 146462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH29076%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [auto1.es] INFO: Saving data for KH29076: {'auction_closing_time': 1765037734.0, 'created_time': 1763572017.923573, 'last_price_update_time': 1764954243.986828}
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH29076') HTTP/1.1" 204 0
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL80540> (referer: https://www.auto1.com/v1/car-details-view/ZL80540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT21379> (referer: https://www.auto1.com/v1/car-details-view/PT21379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA90839> (referer: https://www.auto1.com/v1/car-details-view/NA90839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fa79f03-0e3d-5151-ac78-e6044332a055 with identifier: EG10760
2025-12-05 17:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fa79f03-0e3d-5151-ac78-e6044332a055 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fa79f03-0e3d-5151-ac78-e6044332a055 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1fa79f03-0e3d-5151-ac78-e6044332a055, identifier: EG10760
2025-12-05 17:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1fa79f03-0e3d-5151-ac78-e6044332a055 with identifier: EG10760
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1fa79f03-0e3d-5151-ac78-e6044332a055 with identifier: EG10760
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1fa79f03-0e3d-5151-ac78-e6044332a055 spider: auto1.es
2025-12-05 17:04:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1fa79f03-0e3d-5151-ac78-e6044332a055 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:36:29Z',
 'fuel_type': 'diesel',
 'id': '1fa79f03-0e3d-5151-ac78-e6044332a055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG10760',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 107140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Contrlol M',
 'transmission': 'manual',
 'trim': 'Contrlol M',
 'year': 2020}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG10760%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [auto1.es] INFO: Saving data for EG10760: {'auction_closing_time': 1765038989.0, 'created_time': 1763572025.179273, 'last_price_update_time': 1764954244.302542}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG10760') HTTP/1.1" 204 0
2025-12-05 17:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2025-12-05 17:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186f73d9-8486-5d5f-92e8-8a38cdf151bd with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 186f73d9-8486-5d5f-92e8-8a38cdf151bd with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 186f73d9-8486-5d5f-92e8-8a38cdf151bd, identifier: ZL80540
2025-12-05 17:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3149f793-5ffa-5c84-935e-b34c478ef637 with identifier: PT21379
2025-12-05 17:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3149f793-5ffa-5c84-935e-b34c478ef637 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3149f793-5ffa-5c84-935e-b34c478ef637 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3149f793-5ffa-5c84-935e-b34c478ef637, identifier: PT21379
2025-12-05 17:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b946ccd5-b005-5ad9-a42c-1fb341750b65 with identifier: NA90839
2025-12-05 17:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b946ccd5-b005-5ad9-a42c-1fb341750b65 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b946ccd5-b005-5ad9-a42c-1fb341750b65 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b946ccd5-b005-5ad9-a42c-1fb341750b65, identifier: NA90839
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT53297> (referer: https://www.auto1.com/v1/car-details-view/BT53297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2025-12-05 17:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540 to the API
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL80540>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2025-12-06T16:16:41Z',
 'fuel_type': 'petrol',
 'id': '186f73d9-8486-5d5f-92e8-8a38cdf151bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL80540',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 87993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Turbo SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2020}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [auto1.es] INFO: Saving data for ZL80540: {'auction_closing_time': 1765037801.0, 'created_time': 1762261099.797233, 'last_price_update_time': 1764954244.937177}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL80540') HTTP/1.1" 204 0
2025-12-05 17:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3149f793-5ffa-5c84-935e-b34c478ef637 with identifier: PT21379
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3149f793-5ffa-5c84-935e-b34c478ef637 with identifier: PT21379
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3149f793-5ffa-5c84-935e-b34c478ef637 spider: auto1.es
2025-12-05 17:04:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3149f793-5ffa-5c84-935e-b34c478ef637 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:40:39Z',
 'fuel_type': 'diesel',
 'id': '3149f793-5ffa-5c84-935e-b34c478ef637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT21379',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 156367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten lang FWD',
 'transmission': 'manual',
 'trim': 'Kasten lang FWD',
 'year': 2022}
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT21379%27 HTTP/1.1" 200 None
2025-12-05 17:04:05 [auto1.es] INFO: Saving data for PT21379: {'auction_closing_time': 1765039239.0, 'created_time': 1763398849.74491, 'last_price_update_time': 1764954245.146909}
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PT21379') HTTP/1.1" 204 0
2025-12-05 17:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b946ccd5-b005-5ad9-a42c-1fb341750b65 with identifier: NA90839
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b946ccd5-b005-5ad9-a42c-1fb341750b65 with identifier: NA90839
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b946ccd5-b005-5ad9-a42c-1fb341750b65 spider: auto1.es
2025-12-05 17:04:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b946ccd5-b005-5ad9-a42c-1fb341750b65 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:39:04Z',
 'fuel_type': 'electro',
 'id': 'b946ccd5-b005-5ad9-a42c-1fb341750b65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA90839',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 66979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito extralang',
 'transmission': 'automatic',
 'trim': 'e extralang',
 'year': 2020}
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2025-12-05 17:04:05 [auto1.es] INFO: Saving data for NA90839: {'auction_closing_time': 1765039144.0, 'created_time': 1762967055.657346, 'last_price_update_time': 1764954245.380275}
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA90839') HTTP/1.1" 204 0
2025-12-05 17:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG84496> (referer: https://www.auto1.com/v1/car-details-view/XG84496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS63080> (referer: https://www.auto1.com/v1/car-details-view/WS63080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2025-12-05 17:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with scrape type 2
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with scrape type 2
2025-12-05 17:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644, identifier: BT53297
2025-12-05 17:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2025-12-05 17:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297 to the API
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT53297>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:00:35Z',
 'fuel_type': 'diesel',
 'id': '0dd5597b-f9ff-5c71-a6e1-53aaa0d51644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT53297',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 126450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Landmark Editon',
 'transmission': 'manual',
 'trim': 'Landmark Editon',
 'year': 2020}
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2025-12-05 17:04:05 [auto1.es] INFO: Saving data for BT53297: {'auction_closing_time': 1765036835.0, 'created_time': 1764262888.157419, 'last_price_update_time': 1764954245.811124}
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT53297') HTTP/1.1" 204 0
2025-12-05 17:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fff96ea-a167-5a76-aaa0-0807f3c1a433 with identifier: XG84496
2025-12-05 17:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433 with scrape type 1
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_05127c3bccedd453526156cb0197275c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_05127c3bccedd453526156cb0197275c.jpg not downloaded yet
2025-12-05 17:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a33d021-e216-5dcf-823f-018e077b872d with identifier: WS63080
2025-12-05 17:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a33d021-e216-5dcf-823f-018e077b872d with scrape type 2
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a33d021-e216-5dcf-823f-018e077b872d with scrape type 2
2025-12-05 17:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0a33d021-e216-5dcf-823f-018e077b872d, identifier: WS63080
2025-12-05 17:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0a33d021-e216-5dcf-823f-018e077b872d with identifier: WS63080
2025-12-05 17:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0a33d021-e216-5dcf-823f-018e077b872d with identifier: WS63080
2025-12-05 17:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0a33d021-e216-5dcf-823f-018e077b872d with identifier: WS63080 to the API
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS63080>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-06T16:41:48Z',
 'fuel_type': 'diesel',
 'id': '0a33d021-e216-5dcf-823f-018e077b872d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS63080',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 63340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2022}
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS63080%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [auto1.es] INFO: Saving data for WS63080: {'auction_closing_time': 1765039308.0, 'created_time': 1764262931.720543, 'last_price_update_time': 1764954246.852542}
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WS63080') HTTP/1.1" 204 0
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_39af1837beffad0559dd6fdfe0660e60.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_39af1837beffad0559dd6fdfe0660e60.jpg not downloaded yet
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ28079> (referer: https://www.auto1.com/v1/car-details-view/HJ28079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_29daedf84944921c2ec929e284aa9217.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_29daedf84944921c2ec929e284aa9217.jpg not downloaded yet
2025-12-05 17:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV28926> (referer: https://www.auto1.com/v1/car-details-view/SV28926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF19064> (referer: https://www.auto1.com/v1/car-details-view/VF19064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN58653> (referer: https://www.auto1.com/v1/car-details-view/ZN58653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_1cb466c1b4eff325e37f23c2207eca8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_1cb466c1b4eff325e37f23c2207eca8d.jpg not downloaded yet
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_d4537a534160c846630f8f92517bc899.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_d4537a534160c846630f8f92517bc899.jpg not downloaded yet
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_421e44827c56e9f6d2977d86cb53a941.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_421e44827c56e9f6d2977d86cb53a941.jpg not downloaded yet
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_31d89ac737a4834ea7348b9d34c7539b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_31d89ac737a4834ea7348b9d34c7539b.jpg not downloaded yet
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_62585668d84fd2ea4ca28db487297b3c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_62585668d84fd2ea4ca28db487297b3c.jpg not downloaded yet
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_819bee52be871c021d2e0a3eeffb0e46.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_819bee52be871c021d2e0a3eeffb0e46.jpg not downloaded yet
2025-12-05 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_05127c3bccedd453526156cb0197275c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_9aebc72089580ebd061b16c70c0d8f20.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_9aebc72089580ebd061b16c70c0d8f20.jpg not downloaded yet
2025-12-05 17:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b7a625-a929-5aba-aa5d-ab8ab7e25129 with identifier: HJ28079
2025-12-05 17:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b7a625-a929-5aba-aa5d-ab8ab7e25129 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01b7a625-a929-5aba-aa5d-ab8ab7e25129 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01b7a625-a929-5aba-aa5d-ab8ab7e25129, identifier: HJ28079
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_23fee62162a4e1390e24a5a87ef0b9da.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_23fee62162a4e1390e24a5a87ef0b9da.jpg not downloaded yet
2025-12-05 17:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01b7a625-a929-5aba-aa5d-ab8ab7e25129 with identifier: HJ28079
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01b7a625-a929-5aba-aa5d-ab8ab7e25129 with identifier: HJ28079
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192705 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192705
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 01b7a625-a929-5aba-aa5d-ab8ab7e25129 spider: auto1.es
2025-12-05 17:04:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 01b7a625-a929-5aba-aa5d-ab8ab7e25129 due to rule: high_mileage_for_country.json, error: 192705 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192705
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-06T16:39:16Z',
 'fuel_type': 'diesel',
 'id': '01b7a625-a929-5aba-aa5d-ab8ab7e25129',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ28079',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 192705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ28079%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [auto1.es] INFO: Saving data for HJ28079: {'auction_closing_time': 1765039156.0, 'created_time': 1762880480.182642, 'last_price_update_time': 1764954247.383995}
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HJ28079') HTTP/1.1" 204 0
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_e674c380914b8a9b2402ce01f69f7b79.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_e674c380914b8a9b2402ce01f69f7b79.jpg not downloaded yet
2025-12-05 17:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fbfdee-5659-57a5-b35a-21fba1b518d0 with identifier: SV28926
2025-12-05 17:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fbfdee-5659-57a5-b35a-21fba1b518d0 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fbfdee-5659-57a5-b35a-21fba1b518d0 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 80fbfdee-5659-57a5-b35a-21fba1b518d0, identifier: SV28926
2025-12-05 17:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 with identifier: VF19064
2025-12-05 17:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4, identifier: VF19064
2025-12-05 17:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3a9de1-9370-57ae-a7ba-c96fd9440bdf with identifier: ZN58653
2025-12-05 17:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3a9de1-9370-57ae-a7ba-c96fd9440bdf with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3a9de1-9370-57ae-a7ba-c96fd9440bdf with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc3a9de1-9370-57ae-a7ba-c96fd9440bdf, identifier: ZN58653
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6bf010>
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_05127c3bccedd453526156cb0197275c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_05127c3bccedd453526156cb0197275c.jpg saved to cache
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_39af1837beffad0559dd6fdfe0660e60.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV49987> (referer: https://www.auto1.com/v1/car-details-view/ZV49987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 80fbfdee-5659-57a5-b35a-21fba1b518d0 with identifier: SV28926
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 80fbfdee-5659-57a5-b35a-21fba1b518d0 with identifier: SV28926
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183655 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183655
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 80fbfdee-5659-57a5-b35a-21fba1b518d0 spider: auto1.es
2025-12-05 17:04:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 80fbfdee-5659-57a5-b35a-21fba1b518d0 due to rule: high_mileage_for_country.json, error: 183655 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183655
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:40:44Z',
 'fuel_type': 'diesel',
 'id': '80fbfdee-5659-57a5-b35a-21fba1b518d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV28926',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 183655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV28926%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [auto1.es] INFO: Saving data for SV28926: {'auction_closing_time': 1765039244.0, 'created_time': 1763571662.531206, 'last_price_update_time': 1764954248.20804}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SV28926') HTTP/1.1" 204 0
2025-12-05 17:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 with identifier: VF19064
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 with identifier: VF19064
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183116 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183116
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 spider: auto1.es
2025-12-05 17:04:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4 due to rule: high_mileage_for_country.json, error: 183116 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183116
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:37:58Z',
 'fuel_type': 'diesel',
 'id': 'e809d275-f6fa-5e3d-ba78-a4ff1d6c3ef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF19064',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 183116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2016}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF19064%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [auto1.es] INFO: Saving data for VF19064: {'auction_closing_time': 1765039078.0, 'created_time': 1762260660.15922, 'last_price_update_time': 1764954248.458508}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF19064') HTTP/1.1" 204 0
2025-12-05 17:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc3a9de1-9370-57ae-a7ba-c96fd9440bdf with identifier: ZN58653
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc3a9de1-9370-57ae-a7ba-c96fd9440bdf with identifier: ZN58653
2025-12-05 17:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc3a9de1-9370-57ae-a7ba-c96fd9440bdf with identifier: ZN58653 to the API
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN58653>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:41:05Z',
 'fuel_type': 'diesel',
 'id': 'fc3a9de1-9370-57ae-a7ba-c96fd9440bdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN58653',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 96027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN58653%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [auto1.es] INFO: Saving data for ZN58653: {'auction_closing_time': 1765039265.0, 'created_time': 1760438573.903261, 'last_price_update_time': 1764954248.774233}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN58653') HTTP/1.1" 204 0
2025-12-05 17:04:08 [scrapy.extensions.logstats] INFO: Crawled 411 pages (at 81 pages/min), scraped 129 items (at 30 items/min)
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_c24f3a5b661b36cd32e42e4baa9a2e6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_c24f3a5b661b36cd32e42e4baa9a2e6c.jpg not downloaded yet
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_819bee52be871c021d2e0a3eeffb0e46.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU54513> (referer: https://www.auto1.com/v1/car-details-view/CU54513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_a5918595622c03f085e78fe85954b163.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_a5918595622c03f085e78fe85954b163.jpg not downloaded yet
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN43784> (referer: https://www.auto1.com/v1/car-details-view/AN43784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a0210>
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_39af1837beffad0559dd6fdfe0660e60.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_39af1837beffad0559dd6fdfe0660e60.jpg saved to cache
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf9ec58-6f42-525f-912a-417b19c553c9 with identifier: ZV49987
2025-12-05 17:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf9ec58-6f42-525f-912a-417b19c553c9 with scrape type 1
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 5cf9ec58-6f42-525f-912a-417b19c553c9
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_77b9ed2e8b66dea5d60b95dfdf53a801.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_77b9ed2e8b66dea5d60b95dfdf53a801.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_4887853174f37c646653393c0f44cdc1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_4887853174f37c646653393c0f44cdc1.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_27485672ee3d0c6e263adf0d75db1fcd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_27485672ee3d0c6e263adf0d75db1fcd.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_5d2e6c92e383afcec1cfbe86a6dd94fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_5d2e6c92e383afcec1cfbe86a6dd94fb.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_bfd811495b0cbca15830731bd35b3e25.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_bfd811495b0cbca15830731bd35b3e25.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_13bbcfefefaa77ded8e2b9dc82bed541.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_13bbcfefefaa77ded8e2b9dc82bed541.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_efaa9de12d2d3d0938b77322a4b94213.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_efaa9de12d2d3d0938b77322a4b94213.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_2b0a0450f3bb4f973656fc2a0d3ed957.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_2b0a0450f3bb4f973656fc2a0d3ed957.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_09b2c49976594d84739bfb08a44c8fb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_09b2c49976594d84739bfb08a44c8fb2.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_8f743582ae73e8a1c5aae2cc6e907d77.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_8f743582ae73e8a1c5aae2cc6e907d77.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_bfe6808c19eff73c3db99da2f392efec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_bfe6808c19eff73c3db99da2f392efec.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_44983c2a483872bb7f6a78cd735659d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_44983c2a483872bb7f6a78cd735659d9.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_07cbdce37c31235e4fed7edef2639926.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_07cbdce37c31235e4fed7edef2639926.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_c781d192ae1dced65a5b55d542417a01.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_c781d192ae1dced65a5b55d542417a01.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_a4db410d98ae8eea98dfdcdc663fb720.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_a4db410d98ae8eea98dfdcdc663fb720.jpg already downloaded
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F12%252Fc9124fb30ae02717bb5f6c010808cda5%252Fpa%252FZV49987_4fd522a9e67c0f97991fc77dd0d57da8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_4fd522a9e67c0f97991fc77dd0d57da8.jpg already downloaded
2025-12-05 17:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5cf9ec58-6f42-525f-912a-417b19c553c9, identifier: ZV49987
2025-12-05 17:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5cf9ec58-6f42-525f-912a-417b19c553c9 with identifier: ZV49987
2025-12-05 17:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5cf9ec58-6f42-525f-912a-417b19c553c9 with identifier: ZV49987
2025-12-05 17:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5cf9ec58-6f42-525f-912a-417b19c553c9 with identifier: ZV49987 to the API
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV49987>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:52:05Z',
 'fuel_type': 'diesel',
 'id': '5cf9ec58-6f42-525f-912a-417b19c553c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV49987',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 146993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_77b9ed2e8b66dea5d60b95dfdf53a801.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_4887853174f37c646653393c0f44cdc1.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_27485672ee3d0c6e263adf0d75db1fcd.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_5d2e6c92e383afcec1cfbe86a6dd94fb.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_bfd811495b0cbca15830731bd35b3e25.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_13bbcfefefaa77ded8e2b9dc82bed541.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_efaa9de12d2d3d0938b77322a4b94213.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_2b0a0450f3bb4f973656fc2a0d3ed957.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_09b2c49976594d84739bfb08a44c8fb2.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_8f743582ae73e8a1c5aae2cc6e907d77.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_bfe6808c19eff73c3db99da2f392efec.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_44983c2a483872bb7f6a78cd735659d9.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_07cbdce37c31235e4fed7edef2639926.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_c781d192ae1dced65a5b55d542417a01.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_a4db410d98ae8eea98dfdcdc663fb720.jpg',
                'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_4fd522a9e67c0f97991fc77dd0d57da8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_77b9ed2e8b66dea5d60b95dfdf53a801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_4887853174f37c646653393c0f44cdc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_27485672ee3d0c6e263adf0d75db1fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_5d2e6c92e383afcec1cfbe86a6dd94fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_bfd811495b0cbca15830731bd35b3e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_13bbcfefefaa77ded8e2b9dc82bed541.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_efaa9de12d2d3d0938b77322a4b94213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_2b0a0450f3bb4f973656fc2a0d3ed957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_09b2c49976594d84739bfb08a44c8fb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_8f743582ae73e8a1c5aae2cc6e907d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_bfe6808c19eff73c3db99da2f392efec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_44983c2a483872bb7f6a78cd735659d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_07cbdce37c31235e4fed7edef2639926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_c781d192ae1dced65a5b55d542417a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_a4db410d98ae8eea98dfdcdc663fb720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf9ec58-6f42-525f-912a-417b19c553c9/5cf9ec58-6f42-525f-912a-417b19c553c9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/12/c9124fb30ae02717bb5f6c010808cda5/pa/ZV49987_4fd522a9e67c0f97991fc77dd0d57da8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.5 dCi N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV49987%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [auto1.es] INFO: Saving data for ZV49987: {'created_time': 1764954249.907277, 'last_price_update_time': 1764954249.907286, 'auction_closing_time': 1765039925.0}
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV49987') HTTP/1.1" 204 0
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_45d13bd84420d9bca857833093583e39.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_45d13bd84420d9bca857833093583e39.jpg not downloaded yet
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_23fee62162a4e1390e24a5a87ef0b9da.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_e674c380914b8a9b2402ce01f69f7b79.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA13852> (referer: https://www.auto1.com/v1/car-details-view/ZA13852/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM12264> (referer: https://www.auto1.com/v1/car-details-view/EM12264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH32538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM12351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP81684> (referer: https://www.auto1.com/v1/car-details-view/LP81684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e45a010>
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_819bee52be871c021d2e0a3eeffb0e46.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_819bee52be871c021d2e0a3eeffb0e46.jpg saved to cache
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d11e3ef-9bcf-576b-af56-3345168ae46a with identifier: CU54513
2025-12-05 17:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d11e3ef-9bcf-576b-af56-3345168ae46a with scrape type 2
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d11e3ef-9bcf-576b-af56-3345168ae46a with scrape type 2
2025-12-05 17:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d11e3ef-9bcf-576b-af56-3345168ae46a, identifier: CU54513
2025-12-05 17:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de195380-7756-5735-9f0e-49ed6941030d with identifier: AN43784
2025-12-05 17:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de195380-7756-5735-9f0e-49ed6941030d with scrape type 2
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de195380-7756-5735-9f0e-49ed6941030d with scrape type 2
2025-12-05 17:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de195380-7756-5735-9f0e-49ed6941030d, identifier: AN43784
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_9aebc72089580ebd061b16c70c0d8f20.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_8347195cc9f729c784ba90730c7eae7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_8347195cc9f729c784ba90730c7eae7b.jpg not downloaded yet
2025-12-05 17:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d11e3ef-9bcf-576b-af56-3345168ae46a with identifier: CU54513
2025-12-05 17:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d11e3ef-9bcf-576b-af56-3345168ae46a with identifier: CU54513
2025-12-05 17:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d11e3ef-9bcf-576b-af56-3345168ae46a with identifier: CU54513 to the API
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU54513>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:31:23Z',
 'fuel_type': 'petrol',
 'id': '4d11e3ef-9bcf-576b-af56-3345168ae46a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU54513',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mazda',
 'model': '3',
 'odometer': 136766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.0 Evolution',
 'transmission': 'manual',
 'trim': 'Evolution',
 'year': 2022}
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU54513%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [auto1.es] INFO: Saving data for CU54513: {'auction_closing_time': 1765038683.0, 'created_time': 1758540959.163669, 'last_price_update_time': 1764954250.921458}
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CU54513') HTTP/1.1" 204 0
2025-12-05 17:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de195380-7756-5735-9f0e-49ed6941030d with identifier: AN43784
2025-12-05 17:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de195380-7756-5735-9f0e-49ed6941030d with identifier: AN43784
2025-12-05 17:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de195380-7756-5735-9f0e-49ed6941030d with identifier: AN43784 to the API
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN43784>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:52:57Z',
 'fuel_type': 'petrol',
 'id': 'de195380-7756-5735-9f0e-49ed6941030d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN43784',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 78398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2022}
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN43784%27 HTTP/1.1" 200 None
2025-12-05 17:04:11 [auto1.es] INFO: Saving data for AN43784: {'auction_closing_time': 1765039977.0, 'created_time': 1764263079.147834, 'last_price_update_time': 1764954251.486541}
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AN43784') HTTP/1.1" 204 0
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_c24f3a5b661b36cd32e42e4baa9a2e6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_62585668d84fd2ea4ca28db487297b3c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9e6d10>
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_23fee62162a4e1390e24a5a87ef0b9da.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_23fee62162a4e1390e24a5a87ef0b9da.jpg saved to cache
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcdad0>
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_e674c380914b8a9b2402ce01f69f7b79.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_e674c380914b8a9b2402ce01f69f7b79.jpg saved to cache
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 320c6a3f-6013-5dbc-834e-aeba4becb8c5 with identifier: ZA13852
2025-12-05 17:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 320c6a3f-6013-5dbc-834e-aeba4becb8c5 with scrape type 2
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 320c6a3f-6013-5dbc-834e-aeba4becb8c5 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 320c6a3f-6013-5dbc-834e-aeba4becb8c5, identifier: ZA13852
2025-12-05 17:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264
2025-12-05 17:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9555488-21ad-5f6b-859f-107133df2833 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9555488-21ad-5f6b-859f-107133df2833 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9555488-21ad-5f6b-859f-107133df2833, identifier: EM12264
2025-12-05 17:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684
2025-12-05 17:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bd97d5-501d-52c9-a969-64ec73d7bb35 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60bd97d5-501d-52c9-a969-64ec73d7bb35 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60bd97d5-501d-52c9-a969-64ec73d7bb35, identifier: LP81684
2025-12-05 17:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 320c6a3f-6013-5dbc-834e-aeba4becb8c5 with identifier: ZA13852
2025-12-05 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 320c6a3f-6013-5dbc-834e-aeba4becb8c5 with identifier: ZA13852
2025-12-05 17:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 320c6a3f-6013-5dbc-834e-aeba4becb8c5 with identifier: ZA13852 to the API
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZA13852>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:16:15Z',
 'fuel_type': 'hybrid',
 'id': '320c6a3f-6013-5dbc-834e-aeba4becb8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA13852',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 64357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA13852%27 HTTP/1.1" 200 None
2025-12-05 17:04:12 [auto1.es] INFO: Saving data for ZA13852: {'auction_closing_time': 1765037775.0, 'created_time': 1763658172.175145, 'last_price_update_time': 1764954252.556216}
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA13852') HTTP/1.1" 204 0
2025-12-05 17:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264
2025-12-05 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264
2025-12-05 17:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264 to the API
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM12264>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:56:50Z',
 'fuel_type': 'diesel',
 'id': 'f9555488-21ad-5f6b-859f-107133df2833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM12264',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 35256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM12264%27 HTTP/1.1" 200 None
2025-12-05 17:04:13 [auto1.es] INFO: Saving data for EM12264: {'auction_closing_time': 1765040210.0, 'created_time': 1764263019.978216, 'last_price_update_time': 1764954253.076066}
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM12264') HTTP/1.1" 204 0
2025-12-05 17:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684
2025-12-05 17:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684
2025-12-05 17:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684 to the API
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP81684>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:52:23Z',
 'fuel_type': 'diesel',
 'id': '60bd97d5-501d-52c9-a969-64ec73d7bb35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP81684',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 145355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP81684%27 HTTP/1.1" 200 None
2025-12-05 17:04:13 [auto1.es] INFO: Saving data for LP81684: {'auction_closing_time': 1765039943.0, 'created_time': 1762880546.893437, 'last_price_update_time': 1764954253.463552}
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP81684') HTTP/1.1" 204 0
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8afbd0>
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_9aebc72089580ebd061b16c70c0d8f20.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_9aebc72089580ebd061b16c70c0d8f20.jpg saved to cache
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_a5918595622c03f085e78fe85954b163.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_d4537a534160c846630f8f92517bc899.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_31d89ac737a4834ea7348b9d34c7539b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_29daedf84944921c2ec929e284aa9217.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_45d13bd84420d9bca857833093583e39.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_421e44827c56e9f6d2977d86cb53a941.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_1cb466c1b4eff325e37f23c2207eca8d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP18291> (referer: https://www.auto1.com/v1/car-details-view/EP18291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK85431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE60241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8f3450>
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_c24f3a5b661b36cd32e42e4baa9a2e6c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_c24f3a5b661b36cd32e42e4baa9a2e6c.jpg saved to cache
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e44ad50>
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_62585668d84fd2ea4ca28db487297b3c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_62585668d84fd2ea4ca28db487297b3c.jpg saved to cache
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_8347195cc9f729c784ba90730c7eae7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6cc10>
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_a5918595622c03f085e78fe85954b163.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_a5918595622c03f085e78fe85954b163.jpg saved to cache
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66906288d0>
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_d4537a534160c846630f8f92517bc899.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_d4537a534160c846630f8f92517bc899.jpg saved to cache
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668daf1250>
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_31d89ac737a4834ea7348b9d34c7539b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_31d89ac737a4834ea7348b9d34c7539b.jpg saved to cache
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6b8f90>
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_29daedf84944921c2ec929e284aa9217.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_29daedf84944921c2ec929e284aa9217.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc26d50>
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_45d13bd84420d9bca857833093583e39.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_45d13bd84420d9bca857833093583e39.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9420d0>
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_421e44827c56e9f6d2977d86cb53a941.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_421e44827c56e9f6d2977d86cb53a941.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e81af10>
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_1cb466c1b4eff325e37f23c2207eca8d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_1cb466c1b4eff325e37f23c2207eca8d.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c0bc083-08ff-5b92-af00-3a53cb38af04 with identifier: EP18291
2025-12-05 17:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0bc083-08ff-5b92-af00-3a53cb38af04 with scrape type 2
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c0bc083-08ff-5b92-af00-3a53cb38af04 with scrape type 2
2025-12-05 17:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c0bc083-08ff-5b92-af00-3a53cb38af04, identifier: EP18291
2025-12-05 17:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c0bc083-08ff-5b92-af00-3a53cb38af04 with identifier: EP18291
2025-12-05 17:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c0bc083-08ff-5b92-af00-3a53cb38af04 with identifier: EP18291
2025-12-05 17:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c0bc083-08ff-5b92-af00-3a53cb38af04 with identifier: EP18291 to the API
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP18291>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:06:03Z',
 'fuel_type': 'petrol',
 'id': '8c0bc083-08ff-5b92-af00-3a53cb38af04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP18291',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 64373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP18291%27 HTTP/1.1" 200 None
2025-12-05 17:04:16 [auto1.es] INFO: Saving data for EP18291: {'auction_closing_time': 1765037163.0, 'created_time': 1759856965.746533, 'last_price_update_time': 1764954256.993166}
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP18291') HTTP/1.1" 204 0
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW60593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR76643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN67881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL32817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE12357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e569e10>
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe2%252F42e278218f3a9b8e0ead90d5bc172b05%252Fpa%252FXG84496_8347195cc9f729c784ba90730c7eae7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_8347195cc9f729c784ba90730c7eae7b.jpg saved to cache
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433
2025-12-05 17:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fff96ea-a167-5a76-aaa0-0807f3c1a433, skipping ID generation
2025-12-05 17:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433 with scrape type 1
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0fff96ea-a167-5a76-aaa0-0807f3c1a433 from tracking dictionaries
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fff96ea-a167-5a76-aaa0-0807f3c1a433 sending to next pipeline
2025-12-05 17:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fff96ea-a167-5a76-aaa0-0807f3c1a433, identifier: XG84496
2025-12-05 17:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fff96ea-a167-5a76-aaa0-0807f3c1a433 with identifier: XG84496
2025-12-05 17:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fff96ea-a167-5a76-aaa0-0807f3c1a433 with identifier: XG84496
2025-12-05 17:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fff96ea-a167-5a76-aaa0-0807f3c1a433 with identifier: XG84496 to the API
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_8347195cc9f729c784ba90730c7eae7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:04:23Z',
 'fuel_type': 'petrol',
 'id': '0fff96ea-a167-5a76-aaa0-0807f3c1a433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG84496',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 79321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_05127c3bccedd453526156cb0197275c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_39af1837beffad0559dd6fdfe0660e60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_29daedf84944921c2ec929e284aa9217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_1cb466c1b4eff325e37f23c2207eca8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_d4537a534160c846630f8f92517bc899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_421e44827c56e9f6d2977d86cb53a941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_31d89ac737a4834ea7348b9d34c7539b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_62585668d84fd2ea4ca28db487297b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_819bee52be871c021d2e0a3eeffb0e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_9aebc72089580ebd061b16c70c0d8f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_23fee62162a4e1390e24a5a87ef0b9da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_e674c380914b8a9b2402ce01f69f7b79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_c24f3a5b661b36cd32e42e4baa9a2e6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_a5918595622c03f085e78fe85954b163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_45d13bd84420d9bca857833093583e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fff96ea-a167-5a76-aaa0-0807f3c1a433/0fff96ea-a167-5a76-aaa0-0807f3c1a433_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e2/42e278218f3a9b8e0ead90d5bc172b05/pa/XG84496_8347195cc9f729c784ba90730c7eae7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG84496%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [auto1.es] INFO: Saving data for XG84496: {'created_time': 1764954257.733255, 'last_price_update_time': 1764954257.733266, 'auction_closing_time': 1765037063.0}
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XG84496') HTTP/1.1" 204 0
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG82420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL31812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE80053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: WU13655
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for WU13655: 2
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: UA01703
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA01703%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for UA01703: 2
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM12351> (referer: https://www.auto1.com/v1/car-details-view/XM12351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: DD16750
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD16750%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for DD16750: 2
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: LV26148
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV26148%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for LV26148: 2
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: GE80443
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE80443%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for GE80443: 1
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG43536> (referer: https://www.auto1.com/v1/car-details-view/TG43536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: FS96341
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS96341%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for FS96341: 1
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: TZ75703
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ75703%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for TZ75703: 2
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: NC23900
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC23900%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for NC23900: 2
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: NX56179
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX56179%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for NX56179: 2
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: XK00335
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK00335%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for XK00335: 1
2025-12-05 17:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351
2025-12-05 17:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad57214b-f134-5eba-96f9-7f369c8d7236 with scrape type 2
2025-12-05 17:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad57214b-f134-5eba-96f9-7f369c8d7236 with scrape type 2
2025-12-05 17:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad57214b-f134-5eba-96f9-7f369c8d7236, identifier: XM12351
2025-12-05 17:04:18 [auto1.es] INFO: Found listing with ID: HT97347
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.es] INFO: Scrape type for HT97347: 2
2025-12-05 17:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351
2025-12-05 17:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351
2025-12-05 17:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351 to the API
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XM12351>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:01:40Z',
 'fuel_type': 'diesel',
 'id': 'ad57214b-f134-5eba-96f9-7f369c8d7236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM12351',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 148408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM12351%27 HTTP/1.1" 200 None
2025-12-05 17:04:19 [auto1.es] INFO: Saving data for XM12351: {'auction_closing_time': 1765036900.0, 'created_time': 1764064889.851969, 'last_price_update_time': 1764954259.273398}
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XM12351') HTTP/1.1" 204 0
2025-12-05 17:04:19 [auto1.es] INFO: Found listing with ID: FK55916
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK55916%27 HTTP/1.1" 200 None
2025-12-05 17:04:19 [auto1.es] INFO: Scrape type for FK55916: 2
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB66547> (referer: https://www.auto1.com/v1/car-details-view/BB66547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH32538> (referer: https://www.auto1.com/v1/car-details-view/XH32538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL11544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM25003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG65087/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d with identifier: TG43536
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d, identifier: TG43536
2025-12-05 17:04:19 [auto1.es] INFO: Found listing with ID: ZK88476
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK88476%27 HTTP/1.1" 200 None
2025-12-05 17:04:19 [auto1.es] INFO: Scrape type for ZK88476: 2
2025-12-05 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d with identifier: TG43536
2025-12-05 17:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d with identifier: TG43536
2025-12-05 17:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171743 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171743
2025-12-05 17:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d spider: auto1.es
2025-12-05 17:04:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3b0c0a17-7e1b-5174-b907-bc3bf873fb6d due to rule: high_mileage_for_country.json, error: 171743 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171743
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-06T16:49:04Z',
 'fuel_type': 'petrol',
 'id': '3b0c0a17-7e1b-5174-b907-bc3bf873fb6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG43536',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 171743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG43536%27 HTTP/1.1" 200 None
2025-12-05 17:04:19 [auto1.es] INFO: Saving data for TG43536: {'auction_closing_time': 1765039744.0, 'created_time': 1764003914.762695, 'last_price_update_time': 1764954259.72353}
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG43536') HTTP/1.1" 204 0
2025-12-05 17:04:19 [auto1.es] INFO: Found listing with ID: BW11228
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW11228%27 HTTP/1.1" 200 None
2025-12-05 17:04:19 [auto1.es] INFO: Scrape type for BW11228: 2
2025-12-05 17:04:19 [auto1.es] INFO: Found listing with ID: SR33039
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR33039%27 HTTP/1.1" 200 None
2025-12-05 17:04:19 [auto1.es] INFO: Scrape type for SR33039: 2
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f375d8b-2525-5857-8ee4-e7daf421eeb8 with identifier: BB66547
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f375d8b-2525-5857-8ee4-e7daf421eeb8 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f375d8b-2525-5857-8ee4-e7daf421eeb8 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f375d8b-2525-5857-8ee4-e7daf421eeb8, identifier: BB66547
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0703c17-9d7e-55e3-9ce5-6a9248281401 with identifier: XH32538
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0703c17-9d7e-55e3-9ce5-6a9248281401 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0703c17-9d7e-55e3-9ce5-6a9248281401 with scrape type 2
2025-12-05 17:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0703c17-9d7e-55e3-9ce5-6a9248281401, identifier: XH32538
2025-12-05 17:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f375d8b-2525-5857-8ee4-e7daf421eeb8 with identifier: BB66547
2025-12-05 17:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f375d8b-2525-5857-8ee4-e7daf421eeb8 with identifier: BB66547
2025-12-05 17:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f375d8b-2525-5857-8ee4-e7daf421eeb8 with identifier: BB66547 to the API
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB66547>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:12:30Z',
 'fuel_type': 'petrol',
 'id': '2f375d8b-2525-5857-8ee4-e7daf421eeb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB66547',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 40689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2022}
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB66547%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Saving data for BB66547: {'auction_closing_time': 1765037550.0, 'created_time': 1762362131.241596, 'last_price_update_time': 1764954260.351222}
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB66547') HTTP/1.1" 204 0
2025-12-05 17:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0703c17-9d7e-55e3-9ce5-6a9248281401 with identifier: XH32538
2025-12-05 17:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0703c17-9d7e-55e3-9ce5-6a9248281401 with identifier: XH32538
2025-12-05 17:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187756 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187756
2025-12-05 17:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f0703c17-9d7e-55e3-9ce5-6a9248281401 spider: auto1.es
2025-12-05 17:04:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f0703c17-9d7e-55e3-9ce5-6a9248281401 due to rule: high_mileage_for_country.json, error: 187756 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187756
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:14:30Z',
 'fuel_type': 'diesel',
 'id': 'f0703c17-9d7e-55e3-9ce5-6a9248281401',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH32538',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 187756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2021}
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH32538%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Saving data for XH32538: {'auction_closing_time': 1765037670.0, 'created_time': 1763398947.881324, 'last_price_update_time': 1764954260.60862}
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH32538') HTTP/1.1" 204 0
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: LU53229
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU53229%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for LU53229: 2
2025-12-05 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP89248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK85431> (referer: https://www.auto1.com/v1/car-details-view/GK85431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: BB99040
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB99040%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for BB99040: 2
2025-12-05 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE60241> (referer: https://www.auto1.com/v1/car-details-view/BE60241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: YC26234
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC26234%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for YC26234: 2
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: KL74681
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL74681%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for KL74681: 2
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: ZL27489
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27489%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for ZL27489: 2
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: CL01909
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for CL01909: 2
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: CH50110
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for CH50110: 2
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: ZS75878
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS75878%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for ZS75878: 1
2025-12-05 17:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a37bc77-d953-55b9-9c87-f356e215b86f with identifier: GK85431
2025-12-05 17:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a37bc77-d953-55b9-9c87-f356e215b86f with scrape type 2
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a37bc77-d953-55b9-9c87-f356e215b86f with scrape type 2
2025-12-05 17:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a37bc77-d953-55b9-9c87-f356e215b86f, identifier: GK85431
2025-12-05 17:04:20 [auto1.es] INFO: Found listing with ID: GF40460
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF40460%27 HTTP/1.1" 200 None
2025-12-05 17:04:20 [auto1.es] INFO: Scrape type for GF40460: 1
2025-12-05 17:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a37bc77-d953-55b9-9c87-f356e215b86f with identifier: GK85431
2025-12-05 17:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a37bc77-d953-55b9-9c87-f356e215b86f with identifier: GK85431
2025-12-05 17:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3a37bc77-d953-55b9-9c87-f356e215b86f with identifier: GK85431 to the API
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK85431>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:55:23Z',
 'fuel_type': 'hybrid',
 'id': '3a37bc77-d953-55b9-9c87-f356e215b86f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK85431',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 74499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK85431%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Saving data for GK85431: {'auction_closing_time': 1765040123.0, 'created_time': 1763658062.68952, 'last_price_update_time': 1764954261.224854}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GK85431') HTTP/1.1" 204 0
2025-12-05 17:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fc7c7f-3aaa-5446-af73-d203e9dfc864 with identifier: BE60241
2025-12-05 17:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fc7c7f-3aaa-5446-af73-d203e9dfc864 with scrape type 2
2025-12-05 17:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20fc7c7f-3aaa-5446-af73-d203e9dfc864 with scrape type 2
2025-12-05 17:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20fc7c7f-3aaa-5446-af73-d203e9dfc864, identifier: BE60241
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: JX91298
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX91298%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for JX91298: 2
2025-12-05 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20fc7c7f-3aaa-5446-af73-d203e9dfc864 with identifier: BE60241
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20fc7c7f-3aaa-5446-af73-d203e9dfc864 with identifier: BE60241
2025-12-05 17:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20fc7c7f-3aaa-5446-af73-d203e9dfc864 with identifier: BE60241 to the API
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE60241>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:06:55Z',
 'fuel_type': 'diesel',
 'id': '20fc7c7f-3aaa-5446-af73-d203e9dfc864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE60241',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 113834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Lusso 2WD',
 'transmission': 'automatic',
 'trim': 'Lusso 2WD',
 'year': 2019}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE60241%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Saving data for BE60241: {'auction_closing_time': 1765037215.0, 'created_time': 1763658306.007328, 'last_price_update_time': 1764954261.765094}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE60241') HTTP/1.1" 204 0
2025-12-05 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH33066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL32817> (referer: https://www.auto1.com/v1/car-details-view/DL32817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: FJ56912
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ56912%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for FJ56912: 2
2025-12-05 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE12357> (referer: https://www.auto1.com/v1/car-details-view/SE12357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN67881> (referer: https://www.auto1.com/v1/car-details-view/XN67881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: TS18952
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for TS18952: 2
2025-12-05 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: ZV19691
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV19691%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for ZV19691: 2
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: KE43907
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE43907%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for KE43907: 2
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: YX58635
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX58635%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for YX58635: 2
2025-12-05 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV12827/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: RJ98807
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ98807%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for RJ98807: 1
2025-12-05 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:21 [auto1.es] INFO: Found listing with ID: JD98079
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD98079%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.es] INFO: Scrape type for JD98079: 1
2025-12-05 17:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902c50e1-a2bd-558a-bf37-40b47c97f1ff with identifier: DL32817
2025-12-05 17:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902c50e1-a2bd-558a-bf37-40b47c97f1ff with scrape type 2
2025-12-05 17:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902c50e1-a2bd-558a-bf37-40b47c97f1ff with scrape type 2
2025-12-05 17:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 902c50e1-a2bd-558a-bf37-40b47c97f1ff, identifier: DL32817
2025-12-05 17:04:22 [auto1.es] INFO: Found listing with ID: YY13074
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY13074%27 HTTP/1.1" 200 None
2025-12-05 17:04:22 [auto1.es] INFO: Scrape type for YY13074: 2
2025-12-05 17:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 902c50e1-a2bd-558a-bf37-40b47c97f1ff with identifier: DL32817
2025-12-05 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 902c50e1-a2bd-558a-bf37-40b47c97f1ff with identifier: DL32817
2025-12-05 17:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 902c50e1-a2bd-558a-bf37-40b47c97f1ff with identifier: DL32817 to the API
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL32817>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2025-12-06T16:03:48Z',
 'fuel_type': 'petrol',
 'id': '902c50e1-a2bd-558a-bf37-40b47c97f1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL32817',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 113625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL32817%27 HTTP/1.1" 200 None
2025-12-05 17:04:22 [auto1.es] INFO: Saving data for DL32817: {'auction_closing_time': 1765037028.0, 'created_time': 1762260931.657411, 'last_price_update_time': 1764954262.441897}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL32817') HTTP/1.1" 204 0
2025-12-05 17:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61cf5193-9189-5119-967f-87c73c37c4c5 with identifier: SE12357
2025-12-05 17:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61cf5193-9189-5119-967f-87c73c37c4c5 with scrape type 2
2025-12-05 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61cf5193-9189-5119-967f-87c73c37c4c5 with scrape type 2
2025-12-05 17:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61cf5193-9189-5119-967f-87c73c37c4c5, identifier: SE12357
2025-12-05 17:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36e5a506-0dc1-509a-9bd5-f88301d13e3a with identifier: XN67881
2025-12-05 17:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e5a506-0dc1-509a-9bd5-f88301d13e3a with scrape type 2
2025-12-05 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36e5a506-0dc1-509a-9bd5-f88301d13e3a with scrape type 2
2025-12-05 17:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36e5a506-0dc1-509a-9bd5-f88301d13e3a, identifier: XN67881
2025-12-05 17:04:22 [auto1.es] INFO: Found listing with ID: MD41976
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD41976%27 HTTP/1.1" 200 None
2025-12-05 17:04:22 [auto1.es] INFO: Scrape type for MD41976: 2
2025-12-05 17:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61cf5193-9189-5119-967f-87c73c37c4c5 with identifier: SE12357
2025-12-05 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61cf5193-9189-5119-967f-87c73c37c4c5 with identifier: SE12357
2025-12-05 17:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61cf5193-9189-5119-967f-87c73c37c4c5 with identifier: SE12357 to the API
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE12357>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2025-12-06T16:47:08Z',
 'fuel_type': 'petrol',
 'id': '61cf5193-9189-5119-967f-87c73c37c4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE12357',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '5er',
 'odometer': 99987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2020}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE12357%27 HTTP/1.1" 200 None
2025-12-05 17:04:22 [auto1.es] INFO: Saving data for SE12357: {'auction_closing_time': 1765039628.0, 'created_time': 1760374871.480224, 'last_price_update_time': 1764954262.983941}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SE12357') HTTP/1.1" 204 0
2025-12-05 17:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36e5a506-0dc1-509a-9bd5-f88301d13e3a with identifier: XN67881
2025-12-05 17:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36e5a506-0dc1-509a-9bd5-f88301d13e3a with identifier: XN67881
2025-12-05 17:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36e5a506-0dc1-509a-9bd5-f88301d13e3a with identifier: XN67881 to the API
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN67881>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 394,
 'expiration_date': '2025-12-06T16:03:41Z',
 'fuel_type': 'hybrid',
 'id': '36e5a506-0dc1-509a-9bd5-f88301d13e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN67881',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 143540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN67881%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Saving data for XN67881: {'auction_closing_time': 1765037021.0, 'created_time': 1761584691.463409, 'last_price_update_time': 1764954263.330414}
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN67881') HTTP/1.1" 204 0
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA01703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:23 [auto1.es] INFO: Found listing with ID: BK04731
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK04731%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Scrape type for BK04731: 2
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE80443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL31812> (referer: https://www.auto1.com/v1/car-details-view/BL31812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [auto1.es] INFO: Found listing with ID: KU40584
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU40584%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Scrape type for KU40584: 2
2025-12-05 17:04:23 [auto1.es] INFO: Found listing with ID: DX10530
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX10530%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Scrape type for DX10530: 2
2025-12-05 17:04:23 [auto1.es] INFO: Found listing with ID: JW23528
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW23528%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Scrape type for JW23528: 2
2025-12-05 17:04:23 [auto1.es] INFO: Found listing with ID: BH79865
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH79865%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Scrape type for BH79865: 2
2025-12-05 17:04:23 [auto1.es] INFO: Found listing with ID: UM11413
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM11413%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Scrape type for UM11413: 2
2025-12-05 17:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeef7e2-8131-5767-ba98-e3844717dbcf with identifier: BL31812
2025-12-05 17:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeef7e2-8131-5767-ba98-e3844717dbcf with scrape type 2
2025-12-05 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeef7e2-8131-5767-ba98-e3844717dbcf with scrape type 2
2025-12-05 17:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: deeef7e2-8131-5767-ba98-e3844717dbcf, identifier: BL31812
2025-12-05 17:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: deeef7e2-8131-5767-ba98-e3844717dbcf with identifier: BL31812
2025-12-05 17:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: deeef7e2-8131-5767-ba98-e3844717dbcf with identifier: BL31812
2025-12-05 17:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: deeef7e2-8131-5767-ba98-e3844717dbcf with identifier: BL31812 to the API
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL31812>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:06:24Z',
 'fuel_type': 'diesel',
 'id': 'deeef7e2-8131-5767-ba98-e3844717dbcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL31812',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 57825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL31812%27 HTTP/1.1" 200 None
2025-12-05 17:04:23 [auto1.es] INFO: Saving data for BL31812: {'auction_closing_time': 1765037184.0, 'created_time': 1762347358.960285, 'last_price_update_time': 1764954263.965283}
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BL31812') HTTP/1.1" 204 0
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT97347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX56179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK55916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK00335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC23900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU53229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM25003> (referer: https://www.auto1.com/v1/car-details-view/YM25003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF40460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ56912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1b4aee6-7711-5dba-a2f7-bc264eb9a72e with identifier: YM25003
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b4aee6-7711-5dba-a2f7-bc264eb9a72e with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1b4aee6-7711-5dba-a2f7-bc264eb9a72e with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1b4aee6-7711-5dba-a2f7-bc264eb9a72e, identifier: YM25003
2025-12-05 17:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1b4aee6-7711-5dba-a2f7-bc264eb9a72e with identifier: YM25003
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1b4aee6-7711-5dba-a2f7-bc264eb9a72e with identifier: YM25003
2025-12-05 17:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1b4aee6-7711-5dba-a2f7-bc264eb9a72e with identifier: YM25003 to the API
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM25003>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-06T16:59:10Z',
 'fuel_type': 'diesel',
 'id': 'e1b4aee6-7711-5dba-a2f7-bc264eb9a72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM25003',
 'listing': 'auction',
 'location': 'ES, Loiu (Vizcaya)',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 80407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Signature AWD',
 'transmission': 'automatic',
 'trim': 'Signature AWD',
 'year': 2019}
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM25003%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [auto1.es] INFO: Saving data for YM25003: {'auction_closing_time': 1765040350.0, 'created_time': 1762794367.517416, 'last_price_update_time': 1764954265.456735}
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YM25003') HTTP/1.1" 204 0
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX91298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP89248> (referer: https://www.auto1.com/v1/car-details-view/TP89248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX58635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG65087> (referer: https://www.auto1.com/v1/car-details-view/KG65087/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1214e9b4-c772-525a-8411-f0b2b2854a3e with identifier: TP89248
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1214e9b4-c772-525a-8411-f0b2b2854a3e with scrape type 1
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_9d63b4f4b611c576c5803568921c3d73.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_9d63b4f4b611c576c5803568921c3d73.jpg not downloaded yet
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD41976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_f470369b9e61095cf176b8bf5a135b24.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f470369b9e61095cf176b8bf5a135b24.jpg not downloaded yet
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1 with identifier: KG65087
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1 with scrape type 1
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_fc06711721a27cfa55717f4e2d3284de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_fc06711721a27cfa55717f4e2d3284de.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_45b01cd4a30a45d3fcad1d000f3ebcc2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_45b01cd4a30a45d3fcad1d000f3ebcc2.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_5e1b9d3753c0e2e11d0f2f408d345ae0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_5e1b9d3753c0e2e11d0f2f408d345ae0.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_cf589b91ae15e04631abcce3c9b8e627.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_cf589b91ae15e04631abcce3c9b8e627.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_8cad22226294f1ced9e2862ebeb4cff8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_8cad22226294f1ced9e2862ebeb4cff8.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_8e347a6b5fd810751b76619449fbf473.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_8e347a6b5fd810751b76619449fbf473.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_e53ac2e5357d0be9c833763edbb29533.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_e53ac2e5357d0be9c833763edbb29533.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_6c3ee94a01253d4fb98178aa42a2dade.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_6c3ee94a01253d4fb98178aa42a2dade.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_2b6cc3952c3c4666f7d180cc615baa7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_2b6cc3952c3c4666f7d180cc615baa7b.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_d31ddc5e187038a43dcc1092df7b5e62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_d31ddc5e187038a43dcc1092df7b5e62.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_0c9386038f9565848d4c35fe127fa769.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_0c9386038f9565848d4c35fe127fa769.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_271794f840a4d3bc6e33124a7a0ed137.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_271794f840a4d3bc6e33124a7a0ed137.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_c8fd87d559334fc80aea26d523534562.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_c8fd87d559334fc80aea26d523534562.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_599a470911129db99cdb953752cee8b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_599a470911129db99cdb953752cee8b1.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_6af10d53a0b299ca517a522f8433da5e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_6af10d53a0b299ca517a522f8433da5e.jpg already downloaded
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff3%252Fc0f3370c15299afd46d03d96f7cceb5f%252Fpa%252FKG65087_af6c05f218379dbb3829f2556a97beb8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_af6c05f218379dbb3829f2556a97beb8.jpg already downloaded
2025-12-05 17:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1, identifier: KG65087
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_08c75d777862784b71ce34315e5c8a5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_08c75d777862784b71ce34315e5c8a5b.jpg not downloaded yet
2025-12-05 17:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1 with identifier: KG65087
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1 with identifier: KG65087
2025-12-05 17:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1 with identifier: KG65087 to the API
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG65087>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2025-12-06T16:22:57Z',
 'fuel_type': 'petrol',
 'id': '193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG65087',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 52837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_fc06711721a27cfa55717f4e2d3284de.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_45b01cd4a30a45d3fcad1d000f3ebcc2.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_5e1b9d3753c0e2e11d0f2f408d345ae0.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_cf589b91ae15e04631abcce3c9b8e627.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_8cad22226294f1ced9e2862ebeb4cff8.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_8e347a6b5fd810751b76619449fbf473.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_e53ac2e5357d0be9c833763edbb29533.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_6c3ee94a01253d4fb98178aa42a2dade.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_2b6cc3952c3c4666f7d180cc615baa7b.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_d31ddc5e187038a43dcc1092df7b5e62.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_0c9386038f9565848d4c35fe127fa769.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_271794f840a4d3bc6e33124a7a0ed137.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_c8fd87d559334fc80aea26d523534562.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_599a470911129db99cdb953752cee8b1.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_6af10d53a0b299ca517a522f8433da5e.jpg',
                'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_af6c05f218379dbb3829f2556a97beb8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_fc06711721a27cfa55717f4e2d3284de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3134232,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_45b01cd4a30a45d3fcad1d000f3ebcc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_5e1b9d3753c0e2e11d0f2f408d345ae0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_cf589b91ae15e04631abcce3c9b8e627.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2909209,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_8cad22226294f1ced9e2862ebeb4cff8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_8e347a6b5fd810751b76619449fbf473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_e53ac2e5357d0be9c833763edbb29533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421879,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_6c3ee94a01253d4fb98178aa42a2dade.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_2b6cc3952c3c4666f7d180cc615baa7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_d31ddc5e187038a43dcc1092df7b5e62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_0c9386038f9565848d4c35fe127fa769.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_271794f840a4d3bc6e33124a7a0ed137.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_c8fd87d559334fc80aea26d523534562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_599a470911129db99cdb953752cee8b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_6af10d53a0b299ca517a522f8433da5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1/193f4f5b-ee65-5c6b-80d6-5fdfe2fbc6c1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f3/c0f3370c15299afd46d03d96f7cceb5f/pa/KG65087_af6c05f218379dbb3829f2556a97beb8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Zenith 2WD',
 'transmission': 'manual',
 'trim': 'Zenith 2WD',
 'year': 2019}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG65087%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [auto1.es] INFO: Saving data for KG65087: {'created_time': 1764954266.358706, 'last_price_update_time': 1764954266.358714, 'auction_closing_time': 1765038177.0}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KG65087') HTTP/1.1" 204 0
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_d8ca132a6490d8a8ea6b80f199294103.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d8ca132a6490d8a8ea6b80f199294103.jpg not downloaded yet
2025-12-05 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK04731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_d585656bafced1098262614489ca6a06.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d585656bafced1098262614489ca6a06.jpg not downloaded yet
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_0ebf1504a948806623f0e4798abbe705.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_0ebf1504a948806623f0e4798abbe705.jpg not downloaded yet
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_af9695f97cae90e81c6470d21598d196.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_af9695f97cae90e81c6470d21598d196.jpg not downloaded yet
2025-12-05 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE80443> (referer: https://www.auto1.com/v1/car-details-view/GE80443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_9d63b4f4b611c576c5803568921c3d73.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_2d9965476614f16f8e59385f23211edf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_2d9965476614f16f8e59385f23211edf.jpg not downloaded yet
2025-12-05 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV12827> (referer: https://www.auto1.com/v1/car-details-view/LV12827/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_3cdc17b274516ac69f6a3d662b0286ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3cdc17b274516ac69f6a3d662b0286ea.jpg not downloaded yet
2025-12-05 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_06ac554c2270beb2a401a0edde917bf2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_06ac554c2270beb2a401a0edde917bf2.jpg not downloaded yet
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_3527f642248d2d108c6b237245562ed1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3527f642248d2d108c6b237245562ed1.jpg not downloaded yet
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_cbcc1bc6bf84d7c9ee83420f557ac1ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_cbcc1bc6bf84d7c9ee83420f557ac1ad.jpg not downloaded yet
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_de72b77992bc448dfcee8283e8e1a1ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_de72b77992bc448dfcee8283e8e1a1ea.jpg not downloaded yet
2025-12-05 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_0ebf1504a948806623f0e4798abbe705.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_88ae17765d86363bdabeccd3e865ffef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_88ae17765d86363bdabeccd3e865ffef.jpg not downloaded yet
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_f2822b07ea8cdf6ce10514339e8c920d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f2822b07ea8cdf6ce10514339e8c920d.jpg not downloaded yet
2025-12-05 17:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004e9809-cc06-5f52-bf13-67f7eea1dd97 with identifier: GE80443
2025-12-05 17:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004e9809-cc06-5f52-bf13-67f7eea1dd97 with scrape type 1
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_ec9f0d3743fd444f634724910bdfbf44.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ec9f0d3743fd444f634724910bdfbf44.jpg not downloaded yet
2025-12-05 17:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94b090>
2025-12-05 17:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_9d63b4f4b611c576c5803568921c3d73.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_9d63b4f4b611c576c5803568921c3d73.jpg saved to cache
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9dece2b-d8d1-517e-bf52-6872f6300695 with identifier: LV12827
2025-12-05 17:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9dece2b-d8d1-517e-bf52-6872f6300695 with scrape type 2
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9dece2b-d8d1-517e-bf52-6872f6300695 with scrape type 2
2025-12-05 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b9dece2b-d8d1-517e-bf52-6872f6300695, identifier: LV12827
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_984c394638acbb5b1d696eced99f2afd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_984c394638acbb5b1d696eced99f2afd.jpg not downloaded yet
2025-12-05 17:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b9dece2b-d8d1-517e-bf52-6872f6300695 with identifier: LV12827
2025-12-05 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b9dece2b-d8d1-517e-bf52-6872f6300695 with identifier: LV12827
2025-12-05 17:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b9dece2b-d8d1-517e-bf52-6872f6300695 with identifier: LV12827 to the API
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LV12827>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:57:51Z',
 'fuel_type': 'petrol',
 'id': 'b9dece2b-d8d1-517e-bf52-6872f6300695',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV12827',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 27587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xperience',
 'transmission': 'manual',
 'trim': 'Xperience',
 'year': 2022}
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV12827%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [auto1.es] INFO: Saving data for LV12827: {'auction_closing_time': 1765040271.0, 'created_time': 1762329653.505102, 'last_price_update_time': 1764954267.357135}
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV12827') HTTP/1.1" 204 0
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_de72b77992bc448dfcee8283e8e1a1ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_dcb064341ec9e6b175ac09c46d2197b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dcb064341ec9e6b175ac09c46d2197b4.jpg not downloaded yet
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_af9695f97cae90e81c6470d21598d196.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_2d9965476614f16f8e59385f23211edf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM11413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH79865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW23528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA01703> (referer: https://www.auto1.com/v1/car-details-view/UA01703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_b22db8809d6277d27ab333c512007f6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b22db8809d6277d27ab333c512007f6a.jpg not downloaded yet
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC23900> (referer: https://www.auto1.com/v1/car-details-view/NC23900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7e5d0>
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_0ebf1504a948806623f0e4798abbe705.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_0ebf1504a948806623f0e4798abbe705.jpg saved to cache
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_d4097808f33544d760db1f5f05ded5e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_d4097808f33544d760db1f5f05ded5e8.jpg not downloaded yet
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ec9f0d3743fd444f634724910bdfbf44.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d4410>
2025-12-05 17:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_de72b77992bc448dfcee8283e8e1a1ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_de72b77992bc448dfcee8283e8e1a1ea.jpg saved to cache
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5fe710>
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_af9695f97cae90e81c6470d21598d196.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_af9695f97cae90e81c6470d21598d196.jpg saved to cache
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6f150>
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_2d9965476614f16f8e59385f23211edf.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_2d9965476614f16f8e59385f23211edf.jpg saved to cache
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32c28d62-7f34-5331-a4a0-1c809a1a59bc with identifier: UA01703
2025-12-05 17:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32c28d62-7f34-5331-a4a0-1c809a1a59bc with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32c28d62-7f34-5331-a4a0-1c809a1a59bc with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 32c28d62-7f34-5331-a4a0-1c809a1a59bc, identifier: UA01703
2025-12-05 17:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fbb05bd-a28f-51d4-80c2-f4a773881a42 with identifier: NC23900
2025-12-05 17:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fbb05bd-a28f-51d4-80c2-f4a773881a42 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fbb05bd-a28f-51d4-80c2-f4a773881a42 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5fbb05bd-a28f-51d4-80c2-f4a773881a42, identifier: NC23900
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_ca04aa676c9b92cd544cb89563d632c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ca04aa676c9b92cd544cb89563d632c4.jpg not downloaded yet
2025-12-05 17:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 32c28d62-7f34-5331-a4a0-1c809a1a59bc with identifier: UA01703
2025-12-05 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 32c28d62-7f34-5331-a4a0-1c809a1a59bc with identifier: UA01703
2025-12-05 17:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 32c28d62-7f34-5331-a4a0-1c809a1a59bc with identifier: UA01703 to the API
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA01703>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:26:01Z',
 'fuel_type': 'diesel',
 'id': '32c28d62-7f34-5331-a4a0-1c809a1a59bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA01703',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 142840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA01703%27 HTTP/1.1" 200 None
2025-12-05 17:04:29 [auto1.es] INFO: Saving data for UA01703: {'auction_closing_time': 1765038361.0, 'created_time': 1764003769.534346, 'last_price_update_time': 1764954269.09656}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UA01703') HTTP/1.1" 204 0
2025-12-05 17:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5fbb05bd-a28f-51d4-80c2-f4a773881a42 with identifier: NC23900
2025-12-05 17:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5fbb05bd-a28f-51d4-80c2-f4a773881a42 with identifier: NC23900
2025-12-05 17:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5fbb05bd-a28f-51d4-80c2-f4a773881a42 with identifier: NC23900 to the API
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC23900>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:27:32Z',
 'fuel_type': 'diesel',
 'id': '5fbb05bd-a28f-51d4-80c2-f4a773881a42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC23900',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 84637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC23900%27 HTTP/1.1" 200 None
2025-12-05 17:04:29 [auto1.es] INFO: Saving data for NC23900: {'auction_closing_time': 1765038452.0, 'created_time': 1762967064.300448, 'last_price_update_time': 1764954269.394399}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NC23900') HTTP/1.1" 204 0
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f2822b07ea8cdf6ce10514339e8c920d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3527f642248d2d108c6b237245562ed1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_cbcc1bc6bf84d7c9ee83420f557ac1ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_88ae17765d86363bdabeccd3e865ffef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dcb064341ec9e6b175ac09c46d2197b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_984c394638acbb5b1d696eced99f2afd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_fb8c4d3682e679b998b27a7c31bbc54e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_fb8c4d3682e679b998b27a7c31bbc54e.jpg not downloaded yet
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK00335> (referer: https://www.auto1.com/v1/car-details-view/XK00335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK55916> (referer: https://www.auto1.com/v1/car-details-view/FK55916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7e650>
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_ec9f0d3743fd444f634724910bdfbf44.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ec9f0d3743fd444f634724910bdfbf44.jpg saved to cache
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU53229> (referer: https://www.auto1.com/v1/car-details-view/LU53229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_7c9b2c740415a368725822e62f4a61e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_7c9b2c740415a368725822e62f4a61e2.jpg not downloaded yet
2025-12-05 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b22db8809d6277d27ab333c512007f6a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5fea90>
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_f2822b07ea8cdf6ce10514339e8c920d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f2822b07ea8cdf6ce10514339e8c920d.jpg saved to cache
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e442610>
2025-12-05 17:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_3527f642248d2d108c6b237245562ed1.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3527f642248d2d108c6b237245562ed1.jpg saved to cache
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8e2290>
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_cbcc1bc6bf84d7c9ee83420f557ac1ad.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_cbcc1bc6bf84d7c9ee83420f557ac1ad.jpg saved to cache
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dad7850>
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_88ae17765d86363bdabeccd3e865ffef.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_88ae17765d86363bdabeccd3e865ffef.jpg saved to cache
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5fd390>
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_dcb064341ec9e6b175ac09c46d2197b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dcb064341ec9e6b175ac09c46d2197b4.jpg saved to cache
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6ed10>
2025-12-05 17:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_984c394638acbb5b1d696eced99f2afd.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_984c394638acbb5b1d696eced99f2afd.jpg saved to cache
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc7587be-ef5e-5dda-824e-9c0d95c35b82 with identifier: XK00335
2025-12-05 17:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc7587be-ef5e-5dda-824e-9c0d95c35b82 with scrape type 1
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_f94c81116d4a5cb7fc2afbc55f5eccc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f94c81116d4a5cb7fc2afbc55f5eccc9.jpg not downloaded yet
2025-12-05 17:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 with identifier: FK55916
2025-12-05 17:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 with scrape type 2
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 with scrape type 2
2025-12-05 17:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7, identifier: FK55916
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_eaf354622c00786242573cc7c5910a82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_eaf354622c00786242573cc7c5910a82.jpg not downloaded yet
2025-12-05 17:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 with identifier: FK55916
2025-12-05 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 with identifier: FK55916
2025-12-05 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2025-12-05 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 spider: auto1.es
2025-12-05 17:04:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:15:05Z',
 'fuel_type': 'diesel',
 'id': '72f5eaa5-8cea-52c9-add2-4b87a6f2a7e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK55916',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 174321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi EcoBlue 280 L1 Trend',
 'transmission': 'manual',
 'trim': '280 L1 Trend',
 'year': 2020}
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK55916%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.es] INFO: Saving data for FK55916: {'auction_closing_time': 1765037705.0, 'created_time': 1763034692.734597, 'last_price_update_time': 1764954271.690978}
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK55916') HTTP/1.1" 204 0
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_06ac554c2270beb2a401a0edde917bf2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_54e04f8c7ff1d5afebe474e05dc72520.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_54e04f8c7ff1d5afebe474e05dc72520.jpg not downloaded yet
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3cdc17b274516ac69f6a3d662b0286ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d585656bafced1098262614489ca6a06.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_d4097808f33544d760db1f5f05ded5e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ca04aa676c9b92cd544cb89563d632c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_b02fd349d5527f162b6dc77dfe926382.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b02fd349d5527f162b6dc77dfe926382.jpg not downloaded yet
2025-12-05 17:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c4a793e-97b3-5608-8fa4-94fd58f02e20 with identifier: LU53229
2025-12-05 17:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c4a793e-97b3-5608-8fa4-94fd58f02e20 with scrape type 2
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c4a793e-97b3-5608-8fa4-94fd58f02e20 with scrape type 2
2025-12-05 17:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c4a793e-97b3-5608-8fa4-94fd58f02e20, identifier: LU53229
2025-12-05 17:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc27a50>
2025-12-05 17:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_b22db8809d6277d27ab333c512007f6a.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b22db8809d6277d27ab333c512007f6a.jpg saved to cache
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_fb8c4d3682e679b998b27a7c31bbc54e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_e7faae2afc3113b1dcad2522f2f26112.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_e7faae2afc3113b1dcad2522f2f26112.jpg not downloaded yet
2025-12-05 17:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c4a793e-97b3-5608-8fa4-94fd58f02e20 with identifier: LU53229
2025-12-05 17:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c4a793e-97b3-5608-8fa4-94fd58f02e20 with identifier: LU53229
2025-12-05 17:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1c4a793e-97b3-5608-8fa4-94fd58f02e20 with identifier: LU53229 to the API
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU53229>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 118,
 'expiration_date': '2025-12-06T16:10:18Z',
 'fuel_type': 'electro',
 'id': '1c4a793e-97b3-5608-8fa4-94fd58f02e20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU53229',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 88963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU53229%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [auto1.es] INFO: Saving data for LU53229: {'auction_closing_time': 1765037418.0, 'created_time': 1764003983.255816, 'last_price_update_time': 1764954272.424096}
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LU53229') HTTP/1.1" 204 0
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_dc71067754a718931f48a1ebf4e3bb6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dc71067754a718931f48a1ebf4e3bb6c.jpg not downloaded yet
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d8ca132a6490d8a8ea6b80f199294103.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_f67ffdb3bbfc70d39ace4f6edc14ef80.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f67ffdb3bbfc70d39ace4f6edc14ef80.jpg not downloaded yet
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbdcfd0>
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_06ac554c2270beb2a401a0edde917bf2.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_06ac554c2270beb2a401a0edde917bf2.jpg saved to cache
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db76a90>
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_3cdc17b274516ac69f6a3d662b0286ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3cdc17b274516ac69f6a3d662b0286ea.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbdd9d0>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_d585656bafced1098262614489ca6a06.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d585656bafced1098262614489ca6a06.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7c68d0>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_d4097808f33544d760db1f5f05ded5e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_d4097808f33544d760db1f5f05ded5e8.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d7250>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_ca04aa676c9b92cd544cb89563d632c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ca04aa676c9b92cd544cb89563d632c4.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_a80844cd7ea6aae08dcb90a06b6bf44f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_a80844cd7ea6aae08dcb90a06b6bf44f.jpg not downloaded yet
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7d26d0>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_fb8c4d3682e679b998b27a7c31bbc54e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_fb8c4d3682e679b998b27a7c31bbc54e.jpg saved to cache
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f94c81116d4a5cb7fc2afbc55f5eccc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_93badb223ea840bac7c4062366fd8604.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_93badb223ea840bac7c4062366fd8604.jpg not downloaded yet
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_eaf354622c00786242573cc7c5910a82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_08c75d777862784b71ce34315e5c8a5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_7c9b2c740415a368725822e62f4a61e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_54e04f8c7ff1d5afebe474e05dc72520.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_870e6d2c8470b5be7cf00162660d0a02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_870e6d2c8470b5be7cf00162660d0a02.jpg not downloaded yet
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX56179> (referer: https://www.auto1.com/v1/car-details-view/NX56179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK04731> (referer: https://www.auto1.com/v1/car-details-view/BK04731/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH79865> (referer: https://www.auto1.com/v1/car-details-view/BH79865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX10530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ56912> (referer: https://www.auto1.com/v1/car-details-view/FJ56912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW23528> (referer: https://www.auto1.com/v1/car-details-view/JW23528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT97347> (referer: https://www.auto1.com/v1/car-details-view/HT97347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD41976> (referer: https://www.auto1.com/v1/car-details-view/MD41976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d859810>
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_d8ca132a6490d8a8ea6b80f199294103.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d8ca132a6490d8a8ea6b80f199294103.jpg saved to cache
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_dee976841f6c370550ee4331e9f2fb38.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_dee976841f6c370550ee4331e9f2fb38.jpg not downloaded yet
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_f302e1a43a67953a7135da94e295feea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_f302e1a43a67953a7135da94e295feea.jpg not downloaded yet
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_e7faae2afc3113b1dcad2522f2f26112.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_77c9e8d4fb2f3d2fcb1d45f92759bd10.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_77c9e8d4fb2f3d2fcb1d45f92759bd10.jpg not downloaded yet
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e44a910>
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_f94c81116d4a5cb7fc2afbc55f5eccc9.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f94c81116d4a5cb7fc2afbc55f5eccc9.jpg saved to cache
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b6690>
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_eaf354622c00786242573cc7c5910a82.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_eaf354622c00786242573cc7c5910a82.jpg saved to cache
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b5990>
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_08c75d777862784b71ce34315e5c8a5b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_08c75d777862784b71ce34315e5c8a5b.jpg saved to cache
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab6b50>
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_7c9b2c740415a368725822e62f4a61e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_7c9b2c740415a368725822e62f4a61e2.jpg saved to cache
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6adf50>
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_54e04f8c7ff1d5afebe474e05dc72520.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_54e04f8c7ff1d5afebe474e05dc72520.jpg saved to cache
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46a4f87-37aa-513f-bf17-ae17f8c61c93 with identifier: NX56179
2025-12-05 17:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46a4f87-37aa-513f-bf17-ae17f8c61c93 with scrape type 2
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d46a4f87-37aa-513f-bf17-ae17f8c61c93 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d46a4f87-37aa-513f-bf17-ae17f8c61c93, identifier: NX56179
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbd4aeb-552b-5198-a01b-47f2def42cc1 with identifier: BK04731
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbd4aeb-552b-5198-a01b-47f2def42cc1 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbd4aeb-552b-5198-a01b-47f2def42cc1 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cbd4aeb-552b-5198-a01b-47f2def42cc1, identifier: BK04731
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68058d47-5081-5ad6-94b6-8fb66f19905a with identifier: BH79865
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68058d47-5081-5ad6-94b6-8fb66f19905a with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68058d47-5081-5ad6-94b6-8fb66f19905a with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68058d47-5081-5ad6-94b6-8fb66f19905a, identifier: BH79865
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 with identifier: FJ56912
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7, identifier: FJ56912
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0cd27e8-2777-5044-9ada-5e6ea69ebf89 with identifier: JW23528
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0cd27e8-2777-5044-9ada-5e6ea69ebf89 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0cd27e8-2777-5044-9ada-5e6ea69ebf89 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0cd27e8-2777-5044-9ada-5e6ea69ebf89, identifier: JW23528
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with identifier: HT97347
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae, identifier: HT97347
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae215c6-6b6e-54f9-b986-737a8c5a8820 with identifier: MD41976
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae215c6-6b6e-54f9-b986-737a8c5a8820 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae215c6-6b6e-54f9-b986-737a8c5a8820 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aae215c6-6b6e-54f9-b986-737a8c5a8820, identifier: MD41976
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_adebef5fbd7564e9a721ee93d1e20a19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_adebef5fbd7564e9a721ee93d1e20a19.jpg not downloaded yet
2025-12-05 17:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d46a4f87-37aa-513f-bf17-ae17f8c61c93 with identifier: NX56179
2025-12-05 17:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d46a4f87-37aa-513f-bf17-ae17f8c61c93 with identifier: NX56179
2025-12-05 17:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150529 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150529
2025-12-05 17:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d46a4f87-37aa-513f-bf17-ae17f8c61c93 spider: auto1.es
2025-12-05 17:04:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d46a4f87-37aa-513f-bf17-ae17f8c61c93 due to rule: high_mileage_for_country.json, error: 150529 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150529
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:49:57Z',
 'fuel_type': 'diesel',
 'id': 'd46a4f87-37aa-513f-bf17-ae17f8c61c93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX56179',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 150529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.7 Blue dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX56179%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.es] INFO: Saving data for NX56179: {'auction_closing_time': 1765039797.0, 'created_time': 1763034560.714314, 'last_price_update_time': 1764954276.798474}
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NX56179') HTTP/1.1" 204 0
2025-12-05 17:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cbd4aeb-552b-5198-a01b-47f2def42cc1 with identifier: BK04731
2025-12-05 17:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cbd4aeb-552b-5198-a01b-47f2def42cc1 with identifier: BK04731
2025-12-05 17:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7cbd4aeb-552b-5198-a01b-47f2def42cc1 with identifier: BK04731 to the API
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BK04731>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:46:45Z',
 'fuel_type': 'diesel',
 'id': '7cbd4aeb-552b-5198-a01b-47f2def42cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK04731',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 73443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK04731%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.es] INFO: Saving data for BK04731: {'auction_closing_time': 1765039605.0, 'created_time': 1756314302.334343, 'last_price_update_time': 1764954277.159244}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK04731') HTTP/1.1" 204 0
2025-12-05 17:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68058d47-5081-5ad6-94b6-8fb66f19905a with identifier: BH79865
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68058d47-5081-5ad6-94b6-8fb66f19905a with identifier: BH79865
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164505 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164505
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 68058d47-5081-5ad6-94b6-8fb66f19905a spider: auto1.es
2025-12-05 17:04:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 68058d47-5081-5ad6-94b6-8fb66f19905a due to rule: high_mileage_for_country.json, error: 164505 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164505
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:04:19Z',
 'fuel_type': 'hybrid',
 'id': '68058d47-5081-5ad6-94b6-8fb66f19905a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH79865',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 164505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH79865%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.es] INFO: Saving data for BH79865: {'auction_closing_time': 1765037059.0, 'created_time': 1758733328.908418, 'last_price_update_time': 1764954277.397729}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BH79865') HTTP/1.1" 204 0
2025-12-05 17:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 with identifier: FJ56912
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 with identifier: FJ56912
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177623 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177623
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 spider: auto1.es
2025-12-05 17:04:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7 due to rule: high_mileage_for_country.json, error: 177623 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177623
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2025-12-06T16:21:39Z',
 'fuel_type': 'diesel',
 'id': '8d9634a1-8b8d-58d4-875f-e7c5a44fc9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ56912',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'BMW',
 'model': '5er',
 'odometer': 177623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ56912%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.es] INFO: Saving data for FJ56912: {'auction_closing_time': 1765038099.0, 'created_time': 1764349478.883213, 'last_price_update_time': 1764954277.635653}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ56912') HTTP/1.1" 204 0
2025-12-05 17:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0cd27e8-2777-5044-9ada-5e6ea69ebf89 with identifier: JW23528
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0cd27e8-2777-5044-9ada-5e6ea69ebf89 with identifier: JW23528
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b0cd27e8-2777-5044-9ada-5e6ea69ebf89 spider: auto1.es
2025-12-05 17:04:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b0cd27e8-2777-5044-9ada-5e6ea69ebf89 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:16:55Z',
 'fuel_type': 'diesel',
 'id': 'b0cd27e8-2777-5044-9ada-5e6ea69ebf89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW23528',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 86130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW23528%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.es] INFO: Saving data for JW23528: {'auction_closing_time': 1765037815.0, 'created_time': 1758819672.81388, 'last_price_update_time': 1764954277.840618}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW23528') HTTP/1.1" 204 0
2025-12-05 17:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with identifier: HT97347
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with identifier: HT97347
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
2025-12-05 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae spider: auto1.es
2025-12-05 17:04:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2025-12-06T16:14:24Z',
 'fuel_type': 'gas',
 'id': 'dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT97347',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 198713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Fiorino 1.4 SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2020}
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [auto1.es] INFO: Saving data for HT97347: {'auction_closing_time': 1765037664.0, 'created_time': 1764003677.678781, 'last_price_update_time': 1764954278.047202}
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT97347') HTTP/1.1" 204 0
2025-12-05 17:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aae215c6-6b6e-54f9-b986-737a8c5a8820 with identifier: MD41976
2025-12-05 17:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aae215c6-6b6e-54f9-b986-737a8c5a8820 with identifier: MD41976
2025-12-05 17:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aae215c6-6b6e-54f9-b986-737a8c5a8820 with identifier: MD41976 to the API
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD41976>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:36:05Z',
 'fuel_type': 'diesel',
 'id': 'aae215c6-6b6e-54f9-b986-737a8c5a8820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD41976',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 86552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 AWD',
 'transmission': 'manual',
 'trim': 'AWD',
 'year': 2019}
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD41976%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [auto1.es] INFO: Saving data for MD41976: {'auction_closing_time': 1765038965.0, 'created_time': 1762880475.774636, 'last_price_update_time': 1764954278.380932}
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD41976') HTTP/1.1" 204 0
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_a80844cd7ea6aae08dcb90a06b6bf44f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f67ffdb3bbfc70d39ace4f6edc14ef80.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dc71067754a718931f48a1ebf4e3bb6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_1eec5885fb6deba246bafda9dfdd3b10.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1eec5885fb6deba246bafda9dfdd3b10.jpg not downloaded yet
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f470369b9e61095cf176b8bf5a135b24.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b02fd349d5527f162b6dc77dfe926382.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_93badb223ea840bac7c4062366fd8604.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_87f1b8e1df1c8991a9aa6769b8563edf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_87f1b8e1df1c8991a9aa6769b8563edf.jpg not downloaded yet
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db2bc50>
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_e7faae2afc3113b1dcad2522f2f26112.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_e7faae2afc3113b1dcad2522f2f26112.jpg saved to cache
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_2c4c8b3fe81ca81d396d2a63af02910f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_2c4c8b3fe81ca81d396d2a63af02910f.jpg not downloaded yet
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg not downloaded yet
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_dee976841f6c370550ee4331e9f2fb38.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_0e285afb17d07f632c892f66f10bc277.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0e285afb17d07f632c892f66f10bc277.jpg not downloaded yet
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb0290>
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_a80844cd7ea6aae08dcb90a06b6bf44f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_a80844cd7ea6aae08dcb90a06b6bf44f.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e518690>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_f67ffdb3bbfc70d39ace4f6edc14ef80.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f67ffdb3bbfc70d39ace4f6edc14ef80.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d954150>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_dc71067754a718931f48a1ebf4e3bb6c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dc71067754a718931f48a1ebf4e3bb6c.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82cd10>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F24%252Fa3248f2f171b92aa38f21f3b1bb8432f%252Fpa%252FTP89248_f470369b9e61095cf176b8bf5a135b24.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f470369b9e61095cf176b8bf5a135b24.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1214e9b4-c772-525a-8411-f0b2b2854a3e
2025-12-05 17:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1214e9b4-c772-525a-8411-f0b2b2854a3e, skipping ID generation
2025-12-05 17:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1214e9b4-c772-525a-8411-f0b2b2854a3e with scrape type 1
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1214e9b4-c772-525a-8411-f0b2b2854a3e from tracking dictionaries
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1214e9b4-c772-525a-8411-f0b2b2854a3e sending to next pipeline
2025-12-05 17:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1214e9b4-c772-525a-8411-f0b2b2854a3e, identifier: TP89248
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e51a0d0>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_b02fd349d5527f162b6dc77dfe926382.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b02fd349d5527f162b6dc77dfe926382.jpg saved to cache
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82f650>
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_93badb223ea840bac7c4062366fd8604.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_93badb223ea840bac7c4062366fd8604.jpg saved to cache
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1214e9b4-c772-525a-8411-f0b2b2854a3e with identifier: TP89248
2025-12-05 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1214e9b4-c772-525a-8411-f0b2b2854a3e with identifier: TP89248
2025-12-05 17:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1214e9b4-c772-525a-8411-f0b2b2854a3e with identifier: TP89248 to the API
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f470369b9e61095cf176b8bf5a135b24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:52:13Z',
 'fuel_type': 'petrol',
 'id': '1214e9b4-c772-525a-8411-f0b2b2854a3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP89248',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Abarth',
 'model': '124 Spider',
 'odometer': 96841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_9d63b4f4b611c576c5803568921c3d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f470369b9e61095cf176b8bf5a135b24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_08c75d777862784b71ce34315e5c8a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d8ca132a6490d8a8ea6b80f199294103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_d585656bafced1098262614489ca6a06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_0ebf1504a948806623f0e4798abbe705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_af9695f97cae90e81c6470d21598d196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_2d9965476614f16f8e59385f23211edf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3cdc17b274516ac69f6a3d662b0286ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_06ac554c2270beb2a401a0edde917bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_3527f642248d2d108c6b237245562ed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_cbcc1bc6bf84d7c9ee83420f557ac1ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_de72b77992bc448dfcee8283e8e1a1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_88ae17765d86363bdabeccd3e865ffef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_f2822b07ea8cdf6ce10514339e8c920d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1214e9b4-c772-525a-8411-f0b2b2854a3e/1214e9b4-c772-525a-8411-f0b2b2854a3e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/24/a3248f2f171b92aa38f21f3b1bb8432f/pa/TP89248_984c394638acbb5b1d696eced99f2afd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Abarth 124 Spider 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP89248%27 HTTP/1.1" 200 None
2025-12-05 17:04:40 [auto1.es] INFO: Saving data for TP89248: {'created_time': 1764954280.955096, 'last_price_update_time': 1764954280.955107, 'auction_closing_time': 1765039933.0}
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP89248') HTTP/1.1" 204 0
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_adebef5fbd7564e9a721ee93d1e20a19.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_77c9e8d4fb2f3d2fcb1d45f92759bd10.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_0347fc7897ef9cc51a353be22007f471.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0347fc7897ef9cc51a353be22007f471.jpg not downloaded yet
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_870e6d2c8470b5be7cf00162660d0a02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_f302e1a43a67953a7135da94e295feea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX91298> (referer: https://www.auto1.com/v1/car-details-view/JX91298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM11413> (referer: https://www.auto1.com/v1/car-details-view/UM11413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX58635> (referer: https://www.auto1.com/v1/car-details-view/YX58635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF40460> (referer: https://www.auto1.com/v1/car-details-view/GF40460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU40584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY13074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH33066> (referer: https://www.auto1.com/v1/car-details-view/PH33066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD98079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5c63d0>
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_dee976841f6c370550ee4331e9f2fb38.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_dee976841f6c370550ee4331e9f2fb38.jpg saved to cache
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_1c335108a78061bb59d66dbee4a81a3b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1c335108a78061bb59d66dbee4a81a3b.jpg not downloaded yet
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_2c4c8b3fe81ca81d396d2a63af02910f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_db6cc8f833de4b5e86b76b0ba7608ba8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_db6cc8f833de4b5e86b76b0ba7608ba8.jpg not downloaded yet
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82cd50>
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_adebef5fbd7564e9a721ee93d1e20a19.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_adebef5fbd7564e9a721ee93d1e20a19.jpg saved to cache
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e502910>
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_77c9e8d4fb2f3d2fcb1d45f92759bd10.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_77c9e8d4fb2f3d2fcb1d45f92759bd10.jpg saved to cache
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db863d0>
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_870e6d2c8470b5be7cf00162660d0a02.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_870e6d2c8470b5be7cf00162660d0a02.jpg saved to cache
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9bbfd0>
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_f302e1a43a67953a7135da94e295feea.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_f302e1a43a67953a7135da94e295feea.jpg saved to cache
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfee3bd8-ac59-5d99-be49-731ccb3fe6db with identifier: JX91298
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfee3bd8-ac59-5d99-be49-731ccb3fe6db with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfee3bd8-ac59-5d99-be49-731ccb3fe6db with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfee3bd8-ac59-5d99-be49-731ccb3fe6db, identifier: JX91298
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e with identifier: UM11413
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e, identifier: UM11413
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a37f19cb-55d7-5d88-af47-eae9511117fc with identifier: YX58635
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a37f19cb-55d7-5d88-af47-eae9511117fc with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a37f19cb-55d7-5d88-af47-eae9511117fc with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a37f19cb-55d7-5d88-af47-eae9511117fc, identifier: YX58635
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef322325-6fd3-593c-bf49-ce981b5c07cd with scrape type 1
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_dbfbc7d36b6a301e5a5ca8a1869c2969.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_dbfbc7d36b6a301e5a5ca8a1869c2969.jpg not downloaded yet
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d77dd82-1130-51cc-98dc-02a0da0514eb with identifier: PH33066
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d77dd82-1130-51cc-98dc-02a0da0514eb with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d77dd82-1130-51cc-98dc-02a0da0514eb with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d77dd82-1130-51cc-98dc-02a0da0514eb, identifier: PH33066
2025-12-05 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfee3bd8-ac59-5d99-be49-731ccb3fe6db with identifier: JX91298
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfee3bd8-ac59-5d99-be49-731ccb3fe6db with identifier: JX91298
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160920 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160920
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dfee3bd8-ac59-5d99-be49-731ccb3fe6db spider: auto1.es
2025-12-05 17:04:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dfee3bd8-ac59-5d99-be49-731ccb3fe6db due to rule: high_mileage_for_country.json, error: 160920 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160920
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:03:26Z',
 'fuel_type': 'diesel',
 'id': 'dfee3bd8-ac59-5d99-be49-731ccb3fe6db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX91298',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 160920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX91298%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [auto1.es] INFO: Saving data for JX91298: {'auction_closing_time': 1765037006.0, 'created_time': 1762535000.303612, 'last_price_update_time': 1764954283.077854}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JX91298') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e with identifier: UM11413
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e with identifier: UM11413
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188379 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188379
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e spider: auto1.es
2025-12-05 17:04:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e due to rule: high_mileage_for_country.json, error: 188379 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188379
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 381,
 'expiration_date': '2025-12-06T16:03:31Z',
 'fuel_type': 'hybrid',
 'id': 'ac3eeb42-d7d7-51a1-8ff2-4253dabb3d3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM11413',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 188379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 eHybrid Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2023}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM11413%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [auto1.es] INFO: Saving data for UM11413: {'auction_closing_time': 1765037011.0, 'created_time': 1762880555.355628, 'last_price_update_time': 1764954283.29493}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UM11413') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a37f19cb-55d7-5d88-af47-eae9511117fc with identifier: YX58635
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a37f19cb-55d7-5d88-af47-eae9511117fc with identifier: YX58635
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181010 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181010
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a37f19cb-55d7-5d88-af47-eae9511117fc spider: auto1.es
2025-12-05 17:04:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a37f19cb-55d7-5d88-af47-eae9511117fc due to rule: high_mileage_for_country.json, error: 181010 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181010
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2025-12-06T16:07:17Z',
 'fuel_type': 'hybrid',
 'id': 'a37f19cb-55d7-5d88-af47-eae9511117fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX58635',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 181010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2020}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX58635%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [auto1.es] INFO: Saving data for YX58635: {'auction_closing_time': 1765037237.0, 'created_time': 1759770159.119346, 'last_price_update_time': 1764954283.491145}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YX58635') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d77dd82-1130-51cc-98dc-02a0da0514eb with identifier: PH33066
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d77dd82-1130-51cc-98dc-02a0da0514eb with identifier: PH33066
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9d77dd82-1130-51cc-98dc-02a0da0514eb spider: auto1.es
2025-12-05 17:04:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9d77dd82-1130-51cc-98dc-02a0da0514eb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:39:36Z',
 'fuel_type': 'diesel',
 'id': '9d77dd82-1130-51cc-98dc-02a0da0514eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH33066',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 109003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Live M',
 'transmission': 'manual',
 'trim': 'Live M',
 'year': 2021}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH33066%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [auto1.es] INFO: Saving data for PH33066: {'auction_closing_time': 1765039176.0, 'created_time': 1763791327.02393, 'last_price_update_time': 1764954283.708371}
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH33066') HTTP/1.1" 204 0
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0347fc7897ef9cc51a353be22007f471.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_87f1b8e1df1c8991a9aa6769b8563edf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1eec5885fb6deba246bafda9dfdd3b10.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_d12570d3428931c63ba632ee5bd03279.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_d12570d3428931c63ba632ee5bd03279.jpg not downloaded yet
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_d45d0f4c588529d5014ddc8e8999433c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_d45d0f4c588529d5014ddc8e8999433c.jpg not downloaded yet
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0e285afb17d07f632c892f66f10bc277.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b0e50>
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_2c4c8b3fe81ca81d396d2a63af02910f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_2c4c8b3fe81ca81d396d2a63af02910f.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_7cce4fccbb509677daa878bd59b38700.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_7cce4fccbb509677daa878bd59b38700.jpg not downloaded yet
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_9224640f3acfc806aac5c9ae520fd302.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_9224640f3acfc806aac5c9ae520fd302.jpg not downloaded yet
2025-12-05 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1c335108a78061bb59d66dbee4a81a3b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_00d4451fa603b43bd6241b0f3e96a1ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_00d4451fa603b43bd6241b0f3e96a1ab.jpg not downloaded yet
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_32ca7d95cfd1b3ab7e538ae2b54d5754.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_32ca7d95cfd1b3ab7e538ae2b54d5754.jpg not downloaded yet
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e546590>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_0347fc7897ef9cc51a353be22007f471.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0347fc7897ef9cc51a353be22007f471.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7c4fd0>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_87f1b8e1df1c8991a9aa6769b8563edf.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_87f1b8e1df1c8991a9aa6769b8563edf.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97fa50>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_1eec5885fb6deba246bafda9dfdd3b10.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1eec5885fb6deba246bafda9dfdd3b10.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e728290>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_0e285afb17d07f632c892f66f10bc277.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0e285afb17d07f632c892f66f10bc277.jpg saved to cache
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e67a390>
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F72%252Ffa72f946ad2cbea7a07e3838916817a7%252Fpa%252FGE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg saved to cache
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 004e9809-cc06-5f52-bf13-67f7eea1dd97
2025-12-05 17:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 004e9809-cc06-5f52-bf13-67f7eea1dd97, skipping ID generation
2025-12-05 17:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004e9809-cc06-5f52-bf13-67f7eea1dd97 with scrape type 1
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 004e9809-cc06-5f52-bf13-67f7eea1dd97 from tracking dictionaries
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 004e9809-cc06-5f52-bf13-67f7eea1dd97 sending to next pipeline
2025-12-05 17:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 004e9809-cc06-5f52-bf13-67f7eea1dd97, identifier: GE80443
2025-12-05 17:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 004e9809-cc06-5f52-bf13-67f7eea1dd97 with identifier: GE80443
2025-12-05 17:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 004e9809-cc06-5f52-bf13-67f7eea1dd97 with identifier: GE80443
2025-12-05 17:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 004e9809-cc06-5f52-bf13-67f7eea1dd97 with identifier: GE80443 to the API
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:59:52Z',
 'fuel_type': 'petrol',
 'id': '004e9809-cc06-5f52-bf13-67f7eea1dd97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE80443',
 'listing': 'auction',
 'location': 'ES, Badajoz',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 34096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ec9f0d3743fd444f634724910bdfbf44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dcb064341ec9e6b175ac09c46d2197b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b22db8809d6277d27ab333c512007f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_d4097808f33544d760db1f5f05ded5e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_ca04aa676c9b92cd544cb89563d632c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_fb8c4d3682e679b998b27a7c31bbc54e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_7c9b2c740415a368725822e62f4a61e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_eaf354622c00786242573cc7c5910a82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_b02fd349d5527f162b6dc77dfe926382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_dc71067754a718931f48a1ebf4e3bb6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_a80844cd7ea6aae08dcb90a06b6bf44f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_870e6d2c8470b5be7cf00162660d0a02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_f302e1a43a67953a7135da94e295feea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_adebef5fbd7564e9a721ee93d1e20a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_87f1b8e1df1c8991a9aa6769b8563edf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004e9809-cc06-5f52-bf13-67f7eea1dd97/004e9809-cc06-5f52-bf13-67f7eea1dd97_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/72/fa72f946ad2cbea7a07e3838916817a7/pa/GE80443_aa79a0a2931a2346ff82dbdfb2604423.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Adrenalin',
 'transmission': 'manual',
 'trim': 'Adrenalin',
 'year': 2022}
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE80443%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [auto1.es] INFO: Saving data for GE80443: {'created_time': 1764954287.720052, 'last_price_update_time': 1764954287.720062, 'auction_closing_time': 1765040392.0}
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GE80443') HTTP/1.1" 204 0
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_db6cc8f833de4b5e86b76b0ba7608ba8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_b599541c3f0c188f98a6e1e891073427.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_b599541c3f0c188f98a6e1e891073427.jpg not downloaded yet
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_dbfbc7d36b6a301e5a5ca8a1869c2969.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_d45d0f4c588529d5014ddc8e8999433c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_fe45912c0313ec791b02a22fad8f80aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_fe45912c0313ec791b02a22fad8f80aa.jpg not downloaded yet
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66906c7990>
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_1c335108a78061bb59d66dbee4a81a3b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1c335108a78061bb59d66dbee4a81a3b.jpg saved to cache
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_4270f60c3154c9ac829fb73031e6bbde.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_4270f60c3154c9ac829fb73031e6bbde.jpg not downloaded yet
2025-12-05 17:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_32ca7d95cfd1b3ab7e538ae2b54d5754.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e60db10>
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_db6cc8f833de4b5e86b76b0ba7608ba8.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_db6cc8f833de4b5e86b76b0ba7608ba8.jpg saved to cache
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d85d9d0>
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_dbfbc7d36b6a301e5a5ca8a1869c2969.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_dbfbc7d36b6a301e5a5ca8a1869c2969.jpg saved to cache
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6e9d0>
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_d45d0f4c588529d5014ddc8e8999433c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_d45d0f4c588529d5014ddc8e8999433c.jpg saved to cache
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_a44d9ae0d795a106c178dbc04b8207e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_a44d9ae0d795a106c178dbc04b8207e5.jpg not downloaded yet
2025-12-05 17:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_00d4451fa603b43bd6241b0f3e96a1ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_b599541c3f0c188f98a6e1e891073427.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_ab43edd0521f477ed1332541a5778395.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_ab43edd0521f477ed1332541a5778395.jpg not downloaded yet
2025-12-05 17:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ98807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8fb9d0>
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_32ca7d95cfd1b3ab7e538ae2b54d5754.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_32ca7d95cfd1b3ab7e538ae2b54d5754.jpg saved to cache
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_897521121f91aec9f7895ee79e5425f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_897521121f91aec9f7895ee79e5425f9.jpg not downloaded yet
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d85c090>
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_00d4451fa603b43bd6241b0f3e96a1ab.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_00d4451fa603b43bd6241b0f3e96a1ab.jpg saved to cache
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da86390>
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_b599541c3f0c188f98a6e1e891073427.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_b599541c3f0c188f98a6e1e891073427.jpg saved to cache
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_e1e4a39fdd4fe73196fcebe24587c564.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_e1e4a39fdd4fe73196fcebe24587c564.jpg not downloaded yet
2025-12-05 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_fe45912c0313ec791b02a22fad8f80aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_4270f60c3154c9ac829fb73031e6bbde.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_a44d9ae0d795a106c178dbc04b8207e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_9224640f3acfc806aac5c9ae520fd302.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_be1ccd75fbd154806ab8008348972f5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_be1ccd75fbd154806ab8008348972f5f.jpg not downloaded yet
2025-12-05 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH50110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_35d65496f1450769f1c9b85644a77257.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_35d65496f1450769f1c9b85644a77257.jpg not downloaded yet
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_82cf4a1e274f65becf7a30afaaee86fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_82cf4a1e274f65becf7a30afaaee86fb.jpg not downloaded yet
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_39957a1827cfeddb09915e8915ccc98e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_39957a1827cfeddb09915e8915ccc98e.jpg not downloaded yet
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_638c39e3dd0e1adfcef28dc863b7c4e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_638c39e3dd0e1adfcef28dc863b7c4e2.jpg not downloaded yet
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a0990>
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_fe45912c0313ec791b02a22fad8f80aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_fe45912c0313ec791b02a22fad8f80aa.jpg saved to cache
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a6690>
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_4270f60c3154c9ac829fb73031e6bbde.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_4270f60c3154c9ac829fb73031e6bbde.jpg saved to cache
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e575350>
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_a44d9ae0d795a106c178dbc04b8207e5.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_a44d9ae0d795a106c178dbc04b8207e5.jpg saved to cache
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc2e50>
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_9224640f3acfc806aac5c9ae520fd302.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_9224640f3acfc806aac5c9ae520fd302.jpg saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_897521121f91aec9f7895ee79e5425f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_e1e4a39fdd4fe73196fcebe24587c564.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE43907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_ab43edd0521f477ed1332541a5778395.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_7cce4fccbb509677daa878bd59b38700.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS18952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS75878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_638c39e3dd0e1adfcef28dc863b7c4e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_39957a1827cfeddb09915e8915ccc98e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8db610>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_897521121f91aec9f7895ee79e5425f9.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_897521121f91aec9f7895ee79e5425f9.jpg saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6edd0>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_e1e4a39fdd4fe73196fcebe24587c564.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_e1e4a39fdd4fe73196fcebe24587c564.jpg saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8ac790>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_ab43edd0521f477ed1332541a5778395.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_ab43edd0521f477ed1332541a5778395.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da73b90>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_7cce4fccbb509677daa878bd59b38700.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_7cce4fccbb509677daa878bd59b38700.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_35d65496f1450769f1c9b85644a77257.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_d12570d3428931c63ba632ee5bd03279.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_82cf4a1e274f65becf7a30afaaee86fb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_be1ccd75fbd154806ab8008348972f5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f2bd0>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_638c39e3dd0e1adfcef28dc863b7c4e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_638c39e3dd0e1adfcef28dc863b7c4e2.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da858d0>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_39957a1827cfeddb09915e8915ccc98e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_39957a1827cfeddb09915e8915ccc98e.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe15d0>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_35d65496f1450769f1c9b85644a77257.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_35d65496f1450769f1c9b85644a77257.jpg saved to cache
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c41d0>
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff2%252F53f250533aa17e6da47bb82a126d95ec%252Fpa%252FXK00335_d12570d3428931c63ba632ee5bd03279.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_d12570d3428931c63ba632ee5bd03279.jpg saved to cache
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bc7587be-ef5e-5dda-824e-9c0d95c35b82
2025-12-05 17:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc7587be-ef5e-5dda-824e-9c0d95c35b82, skipping ID generation
2025-12-05 17:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc7587be-ef5e-5dda-824e-9c0d95c35b82 with scrape type 1
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bc7587be-ef5e-5dda-824e-9c0d95c35b82 from tracking dictionaries
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc7587be-ef5e-5dda-824e-9c0d95c35b82 sending to next pipeline
2025-12-05 17:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc7587be-ef5e-5dda-824e-9c0d95c35b82, identifier: XK00335
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da84810>
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_82cf4a1e274f65becf7a30afaaee86fb.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_82cf4a1e274f65becf7a30afaaee86fb.jpg saved to cache
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e575910>
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fc1%252F03c10cdac330801de6fa269b71e672f9%252Fpa%252FGF40460_be1ccd75fbd154806ab8008348972f5f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_be1ccd75fbd154806ab8008348972f5f.jpg saved to cache
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ef322325-6fd3-593c-bf49-ce981b5c07cd
2025-12-05 17:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef322325-6fd3-593c-bf49-ce981b5c07cd, skipping ID generation
2025-12-05 17:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef322325-6fd3-593c-bf49-ce981b5c07cd with scrape type 1
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef322325-6fd3-593c-bf49-ce981b5c07cd from tracking dictionaries
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef322325-6fd3-593c-bf49-ce981b5c07cd sending to next pipeline
2025-12-05 17:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef322325-6fd3-593c-bf49-ce981b5c07cd, identifier: GF40460
2025-12-05 17:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc7587be-ef5e-5dda-824e-9c0d95c35b82 with identifier: XK00335
2025-12-05 17:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc7587be-ef5e-5dda-824e-9c0d95c35b82 with identifier: XK00335
2025-12-05 17:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc7587be-ef5e-5dda-824e-9c0d95c35b82 with identifier: XK00335 to the API
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_d12570d3428931c63ba632ee5bd03279.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:28:12Z',
 'fuel_type': 'petrol',
 'id': 'bc7587be-ef5e-5dda-824e-9c0d95c35b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK00335',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'Fiat',
 'model': '500',
 'odometer': 120836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f94c81116d4a5cb7fc2afbc55f5eccc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_54e04f8c7ff1d5afebe474e05dc72520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_e7faae2afc3113b1dcad2522f2f26112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_f67ffdb3bbfc70d39ace4f6edc14ef80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_93badb223ea840bac7c4062366fd8604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_dee976841f6c370550ee4331e9f2fb38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_77c9e8d4fb2f3d2fcb1d45f92759bd10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 6989,
             'Height': 144,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1eec5885fb6deba246bafda9dfdd3b10.jpg',
             'Width': 192},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_2c4c8b3fe81ca81d396d2a63af02910f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0e285afb17d07f632c892f66f10bc277.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 7473,
             'Height': 144,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_0347fc7897ef9cc51a353be22007f471.jpg',
             'Width': 192},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 6436,
             'Height': 144,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_1c335108a78061bb59d66dbee4a81a3b.jpg',
             'Width': 192},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_db6cc8f833de4b5e86b76b0ba7608ba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 6531,
             'Height': 144,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_d12570d3428931c63ba632ee5bd03279.jpg',
             'Width': 192},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_7cce4fccbb509677daa878bd59b38700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc7587be-ef5e-5dda-824e-9c0d95c35b82/bc7587be-ef5e-5dda-824e-9c0d95c35b82_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/f2/53f250533aa17e6da47bb82a126d95ec/pa/XK00335_00d4451fa603b43bd6241b0f3e96a1ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK00335%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [auto1.es] INFO: Saving data for XK00335: {'created_time': 1764954294.404868, 'last_price_update_time': 1764954294.404877, 'auction_closing_time': 1765038492.0}
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XK00335') HTTP/1.1" 204 0
2025-12-05 17:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460
2025-12-05 17:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460
2025-12-05 17:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ef322325-6fd3-593c-bf49-ce981b5c07cd with identifier: GF40460 to the API
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_be1ccd75fbd154806ab8008348972f5f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 204,
 'expiration_date': '2025-12-06T16:11:06Z',
 'fuel_type': 'petrol',
 'id': 'ef322325-6fd3-593c-bf49-ce981b5c07cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF40460',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 48670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_dbfbc7d36b6a301e5a5ca8a1869c2969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_d45d0f4c588529d5014ddc8e8999433c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_9224640f3acfc806aac5c9ae520fd302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_32ca7d95cfd1b3ab7e538ae2b54d5754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_b599541c3f0c188f98a6e1e891073427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_fe45912c0313ec791b02a22fad8f80aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_4270f60c3154c9ac829fb73031e6bbde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_a44d9ae0d795a106c178dbc04b8207e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_ab43edd0521f477ed1332541a5778395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_897521121f91aec9f7895ee79e5425f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_e1e4a39fdd4fe73196fcebe24587c564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_be1ccd75fbd154806ab8008348972f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_35d65496f1450769f1c9b85644a77257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_82cf4a1e274f65becf7a30afaaee86fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_39957a1827cfeddb09915e8915ccc98e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef322325-6fd3-593c-bf49-ce981b5c07cd/ef322325-6fd3-593c-bf49-ce981b5c07cd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/c1/03c10cdac330801de6fa269b71e672f9/pa/GF40460_638c39e3dd0e1adfcef28dc863b7c4e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2021}
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF40460%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [auto1.es] INFO: Saving data for GF40460: {'created_time': 1764954294.760783, 'last_price_update_time': 1764954294.760793, 'auction_closing_time': 1765037466.0}
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF40460') HTTP/1.1" 204 0
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL74681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU40584> (referer: https://www.auto1.com/v1/car-details-view/KU40584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d with identifier: KU40584
2025-12-05 17:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d with scrape type 2
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d with scrape type 2
2025-12-05 17:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d, identifier: KU40584
2025-12-05 17:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d with identifier: KU40584
2025-12-05 17:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d with identifier: KU40584
2025-12-05 17:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d with identifier: KU40584 to the API
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KU40584>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:12:27Z',
 'fuel_type': 'electro',
 'id': '9779cb13-82b1-5aee-8ecd-9c1b4ab4f55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU40584',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 47239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 100 kW Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU40584%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [auto1.es] INFO: Saving data for KU40584: {'auction_closing_time': 1765037547.0, 'created_time': 1763658483.650178, 'last_price_update_time': 1764954295.280743}
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KU40584') HTTP/1.1" 204 0
2025-12-05 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY13074> (referer: https://www.auto1.com/v1/car-details-view/YY13074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9795f696-11f2-5799-8358-0ddd500f8a4d with identifier: YY13074
2025-12-05 17:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9795f696-11f2-5799-8358-0ddd500f8a4d with scrape type 2
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9795f696-11f2-5799-8358-0ddd500f8a4d with scrape type 2
2025-12-05 17:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9795f696-11f2-5799-8358-0ddd500f8a4d, identifier: YY13074
2025-12-05 17:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9795f696-11f2-5799-8358-0ddd500f8a4d with identifier: YY13074
2025-12-05 17:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9795f696-11f2-5799-8358-0ddd500f8a4d with identifier: YY13074
2025-12-05 17:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9795f696-11f2-5799-8358-0ddd500f8a4d spider: auto1.es
2025-12-05 17:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9795f696-11f2-5799-8358-0ddd500f8a4d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:02:44Z',
 'fuel_type': 'diesel',
 'id': '9795f696-11f2-5799-8358-0ddd500f8a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY13074',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 126457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Access L1',
 'transmission': 'manual',
 'trim': 'Access L1',
 'year': 2019}
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY13074%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [auto1.es] INFO: Saving data for YY13074: {'auction_closing_time': 1765036964.0, 'created_time': 1762275644.240208, 'last_price_update_time': 1764954296.007087}
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YY13074') HTTP/1.1" 204 0
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL27489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX10530> (referer: https://www.auto1.com/v1/car-details-view/DX10530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a60d631-5acf-50c5-a806-e5ec4e8c1763 with identifier: DX10530
2025-12-05 17:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a60d631-5acf-50c5-a806-e5ec4e8c1763 with scrape type 2
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a60d631-5acf-50c5-a806-e5ec4e8c1763 with scrape type 2
2025-12-05 17:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a60d631-5acf-50c5-a806-e5ec4e8c1763, identifier: DX10530
2025-12-05 17:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a60d631-5acf-50c5-a806-e5ec4e8c1763 with identifier: DX10530
2025-12-05 17:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a60d631-5acf-50c5-a806-e5ec4e8c1763 with identifier: DX10530
2025-12-05 17:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2025-12-05 17:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3a60d631-5acf-50c5-a806-e5ec4e8c1763 spider: auto1.es
2025-12-05 17:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3a60d631-5acf-50c5-a806-e5ec4e8c1763 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:42:43Z',
 'fuel_type': 'diesel',
 'id': '3a60d631-5acf-50c5-a806-e5ec4e8c1763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX10530',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 163653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX10530%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [auto1.es] INFO: Saving data for DX10530: {'auction_closing_time': 1765039363.0, 'created_time': 1760029331.689536, 'last_price_update_time': 1764954296.631451}
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX10530') HTTP/1.1" 204 0
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD98079> (referer: https://www.auto1.com/v1/car-details-view/JD98079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 with identifier: JD98079
2025-12-05 17:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 with scrape type 1
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_418ec047873536529951eec1c1c8be90.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_418ec047873536529951eec1c1c8be90.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_e3e7ceb04d0df5a79bb2cf649d12b266.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_e3e7ceb04d0df5a79bb2cf649d12b266.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_cfffdc67c17d8fc01e43c45394b40118.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_cfffdc67c17d8fc01e43c45394b40118.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_4bc56161ca859b9b6ed780f5c9ecad8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4bc56161ca859b9b6ed780f5c9ecad8c.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_c77031afdc4e14e7c48c66d13121b4d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_c77031afdc4e14e7c48c66d13121b4d7.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_4c859ee6f5a6357f2318edccd36ff1f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4c859ee6f5a6357f2318edccd36ff1f2.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_003fda55e2e357e3033a7341bf03e5df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_003fda55e2e357e3033a7341bf03e5df.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_adab069ca6f718a93353b672ee9bcc0d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_adab069ca6f718a93353b672ee9bcc0d.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_8f0e04a3fee33e861471b84a03566d55.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_8f0e04a3fee33e861471b84a03566d55.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_489d4d99891d47067f7bdf903d80ba27.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_489d4d99891d47067f7bdf903d80ba27.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_bd867ef9a262d558a5be65ec4f597628.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_bd867ef9a262d558a5be65ec4f597628.jpg not downloaded yet
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB99040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_d4dd2a993aaa1674dbaf44235268e076.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_d4dd2a993aaa1674dbaf44235268e076.jpg not downloaded yet
2025-12-05 17:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_772b1e98ffbe0021bea6f986262bafe3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_772b1e98ffbe0021bea6f986262bafe3.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_5869beddee6d4c3476c323e41378e96b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_5869beddee6d4c3476c323e41378e96b.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_a396e9a82cc6e6f804353793bdb996ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_a396e9a82cc6e6f804353793bdb996ba.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_7e59a8661a44485ca0421021f5015c1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_7e59a8661a44485ca0421021f5015c1f.jpg not downloaded yet
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_bd867ef9a262d558a5be65ec4f597628.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6dfd90>
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_bd867ef9a262d558a5be65ec4f597628.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_bd867ef9a262d558a5be65ec4f597628.jpg saved to cache
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_7e59a8661a44485ca0421021f5015c1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH50110> (referer: https://www.auto1.com/v1/car-details-view/CH50110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6dc750>
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_7e59a8661a44485ca0421021f5015c1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_7e59a8661a44485ca0421021f5015c1f.jpg saved to cache
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_a396e9a82cc6e6f804353793bdb996ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL11544> (referer: https://www.auto1.com/v1/car-details-view/SL11544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2025-12-05 17:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cb1834-e1ac-5552-96c3-6d17f8986e21 with scrape type 2
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35cb1834-e1ac-5552-96c3-6d17f8986e21 with scrape type 2
2025-12-05 17:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35cb1834-e1ac-5552-96c3-6d17f8986e21, identifier: CH50110
2025-12-05 17:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2025-12-05 17:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2025-12-05 17:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193064 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193064
2025-12-05 17:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 spider: auto1.es
2025-12-05 17:04:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 35cb1834-e1ac-5552-96c3-6d17f8986e21 due to rule: high_mileage_for_country.json, error: 193064 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193064
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:57:21Z',
 'fuel_type': 'diesel',
 'id': '35cb1834-e1ac-5552-96c3-6d17f8986e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH50110',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 193064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [auto1.es] INFO: Saving data for CH50110: {'auction_closing_time': 1765040241.0, 'created_time': 1762880525.645731, 'last_price_update_time': 1764954298.363545}
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH50110') HTTP/1.1" 204 0
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db76890>
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_a396e9a82cc6e6f804353793bdb996ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_a396e9a82cc6e6f804353793bdb996ba.jpg saved to cache
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e844398-9d10-5529-adeb-8cb96dd3cc56 with identifier: SL11544
2025-12-05 17:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e844398-9d10-5529-adeb-8cb96dd3cc56 with scrape type 1
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4e844398-9d10-5529-adeb-8cb96dd3cc56
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_94ee76f0bf5688544156694bd42f44cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_94ee76f0bf5688544156694bd42f44cb.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_cea9073cf278bab3150b91a15b95d562.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_cea9073cf278bab3150b91a15b95d562.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_1b78370c734ff9fd49d2a80e437929c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_1b78370c734ff9fd49d2a80e437929c0.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_f30c9362a73a97bff21fe61a99dca8e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_f30c9362a73a97bff21fe61a99dca8e7.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_e807f537e116fbcb4d5c2558c447f0f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e807f537e116fbcb4d5c2558c447f0f2.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_e1dcd2eec9f2702fff5cb1f24fca4778.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e1dcd2eec9f2702fff5cb1f24fca4778.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_509aa4985279bcaa0341eabba8546fa6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_509aa4985279bcaa0341eabba8546fa6.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_2c751d76a905e7de26f93f1b93d10392.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_2c751d76a905e7de26f93f1b93d10392.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_02c690490660974fd67f9b3dadbad130.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_02c690490660974fd67f9b3dadbad130.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_7d18e0081166c60095bad7dd0a7f94b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_7d18e0081166c60095bad7dd0a7f94b4.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_9b74f0a062d3bc1f00b305e624809c57.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_9b74f0a062d3bc1f00b305e624809c57.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_80e31de85b561687c9dd289ef73ba3ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_80e31de85b561687c9dd289ef73ba3ad.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_e0c6d68ebcbcbe866abaac315623997a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e0c6d68ebcbcbe866abaac315623997a.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_42f57d641929092bc4f7c29291ee641a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_42f57d641929092bc4f7c29291ee641a.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_09bd76118e020e40970c4f3bcce0924a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_09bd76118e020e40970c4f3bcce0924a.jpg already downloaded
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F6f%252Fb96fcbac3bb87dbc201b9e51ab5c7f0f%252Fpa%252FSL11544_e9e9d52ed49121cd912121ecb5d84134.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e9e9d52ed49121cd912121ecb5d84134.jpg already downloaded
2025-12-05 17:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e844398-9d10-5529-adeb-8cb96dd3cc56, identifier: SL11544
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR33039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e844398-9d10-5529-adeb-8cb96dd3cc56 with identifier: SL11544
2025-12-05 17:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e844398-9d10-5529-adeb-8cb96dd3cc56 with identifier: SL11544
2025-12-05 17:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181367 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181367
2025-12-05 17:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4e844398-9d10-5529-adeb-8cb96dd3cc56 spider: auto1.es
2025-12-05 17:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4e844398-9d10-5529-adeb-8cb96dd3cc56 due to rule: high_mileage_for_country.json, error: 181367 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181367
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:06:22Z',
 'fuel_type': 'hybrid',
 'id': '4e844398-9d10-5529-adeb-8cb96dd3cc56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL11544',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 181367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_94ee76f0bf5688544156694bd42f44cb.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_cea9073cf278bab3150b91a15b95d562.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_1b78370c734ff9fd49d2a80e437929c0.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_f30c9362a73a97bff21fe61a99dca8e7.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e807f537e116fbcb4d5c2558c447f0f2.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e1dcd2eec9f2702fff5cb1f24fca4778.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_509aa4985279bcaa0341eabba8546fa6.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_2c751d76a905e7de26f93f1b93d10392.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_02c690490660974fd67f9b3dadbad130.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_7d18e0081166c60095bad7dd0a7f94b4.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_9b74f0a062d3bc1f00b305e624809c57.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_80e31de85b561687c9dd289ef73ba3ad.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e0c6d68ebcbcbe866abaac315623997a.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_42f57d641929092bc4f7c29291ee641a.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_09bd76118e020e40970c4f3bcce0924a.jpg',
                'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e9e9d52ed49121cd912121ecb5d84134.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_94ee76f0bf5688544156694bd42f44cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_cea9073cf278bab3150b91a15b95d562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_1b78370c734ff9fd49d2a80e437929c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_f30c9362a73a97bff21fe61a99dca8e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e807f537e116fbcb4d5c2558c447f0f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e1dcd2eec9f2702fff5cb1f24fca4778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_509aa4985279bcaa0341eabba8546fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_2c751d76a905e7de26f93f1b93d10392.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_02c690490660974fd67f9b3dadbad130.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2006077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_7d18e0081166c60095bad7dd0a7f94b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2120493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_9b74f0a062d3bc1f00b305e624809c57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_80e31de85b561687c9dd289ef73ba3ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e0c6d68ebcbcbe866abaac315623997a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1966273,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_42f57d641929092bc4f7c29291ee641a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_09bd76118e020e40970c4f3bcce0924a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e844398-9d10-5529-adeb-8cb96dd3cc56/4e844398-9d10-5529-adeb-8cb96dd3cc56_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/6f/b96fcbac3bb87dbc201b9e51ab5c7f0f/pa/SL11544_e9e9d52ed49121cd912121ecb5d84134.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2019}
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL11544%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [auto1.es] INFO: Saving data for SL11544: {'created_time': 1764954299.324474, 'last_price_update_time': 1764954299.324484, 'auction_closing_time': 1765037182.0}
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL11544') HTTP/1.1" 204 0
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_5869beddee6d4c3476c323e41378e96b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_772b1e98ffbe0021bea6f986262bafe3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da84c10>
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_5869beddee6d4c3476c323e41378e96b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_5869beddee6d4c3476c323e41378e96b.jpg saved to cache
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_489d4d99891d47067f7bdf903d80ba27.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_8f0e04a3fee33e861471b84a03566d55.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_d4dd2a993aaa1674dbaf44235268e076.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e658e50>
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_772b1e98ffbe0021bea6f986262bafe3.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_772b1e98ffbe0021bea6f986262bafe3.jpg saved to cache
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW11228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC26234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ98807> (referer: https://www.auto1.com/v1/car-details-view/RJ98807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6360d0>
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_489d4d99891d47067f7bdf903d80ba27.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_489d4d99891d47067f7bdf903d80ba27.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47fb50>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_8f0e04a3fee33e861471b84a03566d55.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_8f0e04a3fee33e861471b84a03566d55.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47ed50>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_d4dd2a993aaa1674dbaf44235268e076.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_d4dd2a993aaa1674dbaf44235268e076.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_003fda55e2e357e3033a7341bf03e5df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_adab069ca6f718a93353b672ee9bcc0d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE43907> (referer: https://www.auto1.com/v1/car-details-view/KE43907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS75878> (referer: https://www.auto1.com/v1/car-details-view/ZS75878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb with identifier: RJ98807
2025-12-05 17:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb with scrape type 1
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_39e150e43dddea988bf6721e44f9ad74.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_39e150e43dddea988bf6721e44f9ad74.jpg not downloaded yet
2025-12-05 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_0de937096bfc79a615cd05731a658485.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0de937096bfc79a615cd05731a658485.jpg not downloaded yet
2025-12-05 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS18952> (referer: https://www.auto1.com/v1/car-details-view/TS18952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4c859ee6f5a6357f2318edccd36ff1f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_1c6315985df4181aa23ae3ed422fd88d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1c6315985df4181aa23ae3ed422fd88d.jpg not downloaded yet
2025-12-05 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_d3db0095906dc328180af869f5c1e711.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d3db0095906dc328180af869f5c1e711.jpg not downloaded yet
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_36c254a4a6174ce34cf1a07461f8fcf7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_36c254a4a6174ce34cf1a07461f8fcf7.jpg not downloaded yet
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbeb710>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_003fda55e2e357e3033a7341bf03e5df.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_003fda55e2e357e3033a7341bf03e5df.jpg saved to cache
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_418ec047873536529951eec1c1c8be90.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_c77031afdc4e14e7c48c66d13121b4d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_e3e7ceb04d0df5a79bb2cf649d12b266.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_7e125de82b1e4a05a95d0869254dd0d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_7e125de82b1e4a05a95d0869254dd0d2.jpg not downloaded yet
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da84510>
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_adab069ca6f718a93353b672ee9bcc0d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_adab069ca6f718a93353b672ee9bcc0d.jpg saved to cache
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9057dd65-1cac-560d-8596-5f61f55257c4 with identifier: KE43907
2025-12-05 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9057dd65-1cac-560d-8596-5f61f55257c4 with scrape type 2
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9057dd65-1cac-560d-8596-5f61f55257c4 with scrape type 2
2025-12-05 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9057dd65-1cac-560d-8596-5f61f55257c4, identifier: KE43907
2025-12-05 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec116a26-6057-50a3-a53c-8971b74c8c98 with identifier: ZS75878
2025-12-05 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec116a26-6057-50a3-a53c-8971b74c8c98 with scrape type 1
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ec116a26-6057-50a3-a53c-8971b74c8c98
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_b5a32295407d6938d5060b980183f8b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_b5a32295407d6938d5060b980183f8b2.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_2c62852ea2915ed18f802de02eed9c1a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_2c62852ea2915ed18f802de02eed9c1a.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_92518f6a1201cbdffb1301f32a0ea03c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_92518f6a1201cbdffb1301f32a0ea03c.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_03d3aa37f25ca00b2d8a0b9771525d14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_03d3aa37f25ca00b2d8a0b9771525d14.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_91c6a6a9942e27a152cdff5142f35f6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_91c6a6a9942e27a152cdff5142f35f6d.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_99cf9ccbeeb5de2595f0b468065fabf8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_99cf9ccbeeb5de2595f0b468065fabf8.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_19a1d9d66281914f0f9315dd4da6b9b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_19a1d9d66281914f0f9315dd4da6b9b9.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_3b1712d7c9170d1c215e0c4ea6e97eb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_3b1712d7c9170d1c215e0c4ea6e97eb2.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_5734f1b86fa9d09c2f8cd5e36d08a355.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_5734f1b86fa9d09c2f8cd5e36d08a355.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_e97f2cb623a2b7f8d57b73419fcd9024.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_e97f2cb623a2b7f8d57b73419fcd9024.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_4b97754dd66a99d1ff849850d87ae640.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_4b97754dd66a99d1ff849850d87ae640.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_e78cca154a86413d2544696359725e5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_e78cca154a86413d2544696359725e5c.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_ac840051c6de4e558fe237c809baf82a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_ac840051c6de4e558fe237c809baf82a.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_35f7b8eb0b66f45bd72db5624d0b9eb6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_35f7b8eb0b66f45bd72db5624d0b9eb6.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_140fb6d06d3e4fe81fe771f27199e94d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_140fb6d06d3e4fe81fe771f27199e94d.jpg already downloaded
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F98%252F5c98163f1d08cee300aa77b0d733951f%252Fpa%252FZS75878_5929814ff2448a56b9167a4171e7b004.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_5929814ff2448a56b9167a4171e7b004.jpg already downloaded
2025-12-05 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec116a26-6057-50a3-a53c-8971b74c8c98, identifier: ZS75878
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_39e150e43dddea988bf6721e44f9ad74.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4bc56161ca859b9b6ed780f5c9ecad8c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0de937096bfc79a615cd05731a658485.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_cfffdc67c17d8fc01e43c45394b40118.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9057dd65-1cac-560d-8596-5f61f55257c4 with identifier: KE43907
2025-12-05 17:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9057dd65-1cac-560d-8596-5f61f55257c4 with identifier: KE43907
2025-12-05 17:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9057dd65-1cac-560d-8596-5f61f55257c4 with identifier: KE43907 to the API
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE43907>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:21:12Z',
 'fuel_type': 'electro',
 'id': '9057dd65-1cac-560d-8596-5f61f55257c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE43907',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 35863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper SE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE43907%27 HTTP/1.1" 200 None
2025-12-05 17:05:03 [auto1.es] INFO: Saving data for KE43907: {'auction_closing_time': 1765038072.0, 'created_time': 1764176768.968272, 'last_price_update_time': 1764954303.212185}
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE43907') HTTP/1.1" 204 0
2025-12-05 17:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec116a26-6057-50a3-a53c-8971b74c8c98 with identifier: ZS75878
2025-12-05 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec116a26-6057-50a3-a53c-8971b74c8c98 with identifier: ZS75878
2025-12-05 17:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec116a26-6057-50a3-a53c-8971b74c8c98 with identifier: ZS75878 to the API
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZS75878>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 73,
 'expiration_date': '2025-12-06T16:41:33Z',
 'fuel_type': 'petrol',
 'id': 'ec116a26-6057-50a3-a53c-8971b74c8c98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS75878',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 44928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_b5a32295407d6938d5060b980183f8b2.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_2c62852ea2915ed18f802de02eed9c1a.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_92518f6a1201cbdffb1301f32a0ea03c.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_03d3aa37f25ca00b2d8a0b9771525d14.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_91c6a6a9942e27a152cdff5142f35f6d.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_99cf9ccbeeb5de2595f0b468065fabf8.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_19a1d9d66281914f0f9315dd4da6b9b9.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_3b1712d7c9170d1c215e0c4ea6e97eb2.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_5734f1b86fa9d09c2f8cd5e36d08a355.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_e97f2cb623a2b7f8d57b73419fcd9024.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_4b97754dd66a99d1ff849850d87ae640.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_e78cca154a86413d2544696359725e5c.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_ac840051c6de4e558fe237c809baf82a.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_35f7b8eb0b66f45bd72db5624d0b9eb6.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_140fb6d06d3e4fe81fe771f27199e94d.jpg',
                'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_5929814ff2448a56b9167a4171e7b004.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_b5a32295407d6938d5060b980183f8b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_2c62852ea2915ed18f802de02eed9c1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_92518f6a1201cbdffb1301f32a0ea03c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_03d3aa37f25ca00b2d8a0b9771525d14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_91c6a6a9942e27a152cdff5142f35f6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_99cf9ccbeeb5de2595f0b468065fabf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_19a1d9d66281914f0f9315dd4da6b9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_3b1712d7c9170d1c215e0c4ea6e97eb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707579,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_5734f1b86fa9d09c2f8cd5e36d08a355.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_e97f2cb623a2b7f8d57b73419fcd9024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_4b97754dd66a99d1ff849850d87ae640.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_e78cca154a86413d2544696359725e5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_ac840051c6de4e558fe237c809baf82a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_35f7b8eb0b66f45bd72db5624d0b9eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_140fb6d06d3e4fe81fe771f27199e94d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec116a26-6057-50a3-a53c-8971b74c8c98/ec116a26-6057-50a3-a53c-8971b74c8c98_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/98/5c98163f1d08cee300aa77b0d733951f/pa/ZS75878_5929814ff2448a56b9167a4171e7b004.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2018}
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS75878%27 HTTP/1.1" 200 None
2025-12-05 17:05:03 [auto1.es] INFO: Saving data for ZS75878: {'created_time': 1764954303.548084, 'last_price_update_time': 1764954303.548096, 'auction_closing_time': 1765039293.0}
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZS75878') HTTP/1.1" 204 0
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_9fbb458816deb08125380cfdbaabb252.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_9fbb458816deb08125380cfdbaabb252.jpg not downloaded yet
2025-12-05 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL01909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV19691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2025-12-05 17:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60543c97-6116-5eeb-b75d-a5fbe33196de with scrape type 2
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60543c97-6116-5eeb-b75d-a5fbe33196de with scrape type 2
2025-12-05 17:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60543c97-6116-5eeb-b75d-a5fbe33196de, identifier: TS18952
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e766d90>
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_4c859ee6f5a6357f2318edccd36ff1f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4c859ee6f5a6357f2318edccd36ff1f2.jpg saved to cache
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e767450>
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_418ec047873536529951eec1c1c8be90.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_418ec047873536529951eec1c1c8be90.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d6a10>
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_c77031afdc4e14e7c48c66d13121b4d7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_c77031afdc4e14e7c48c66d13121b4d7.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac6f10>
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_e3e7ceb04d0df5a79bb2cf649d12b266.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_e3e7ceb04d0df5a79bb2cf649d12b266.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_b38072a34a7423380beacc22107fd582.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_b38072a34a7423380beacc22107fd582.jpg not downloaded yet
2025-12-05 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2025-12-05 17:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2025-12-05 17:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952 to the API
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS18952>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:41:49Z',
 'fuel_type': 'diesel',
 'id': '60543c97-6116-5eeb-b75d-a5fbe33196de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS18952',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 108027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT Pack',
 'transmission': 'manual',
 'trim': 'GT Pack',
 'year': 2021}
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2025-12-05 17:05:05 [auto1.es] INFO: Saving data for TS18952: {'auction_closing_time': 1765039309.0, 'created_time': 1763572014.717796, 'last_price_update_time': 1764954305.05704}
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS18952') HTTP/1.1" 204 0
2025-12-05 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d3db0095906dc328180af869f5c1e711.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1c6315985df4181aa23ae3ed422fd88d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_36c254a4a6174ce34cf1a07461f8fcf7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5474d0>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_39e150e43dddea988bf6721e44f9ad74.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_39e150e43dddea988bf6721e44f9ad74.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c7690>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_4bc56161ca859b9b6ed780f5c9ecad8c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4bc56161ca859b9b6ed780f5c9ecad8c.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8592d0>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_0de937096bfc79a615cd05731a658485.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0de937096bfc79a615cd05731a658485.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e57ced0>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b713dcd161cc08fab5fefe64fbf35e1%252Fpa%252FJD98079_cfffdc67c17d8fc01e43c45394b40118.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_cfffdc67c17d8fc01e43c45394b40118.jpg saved to cache
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47
2025-12-05 17:05:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47, skipping ID generation
2025-12-05 17:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 with scrape type 1
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 from tracking dictionaries
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 sending to next pipeline
2025-12-05 17:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47, identifier: JD98079
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_f58a5ac1060d0480b48e4e4ded42515a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_f58a5ac1060d0480b48e4e4ded42515a.jpg not downloaded yet
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL74681> (referer: https://www.auto1.com/v1/car-details-view/KL74681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK88476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 with identifier: JD98079
2025-12-05 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 with identifier: JD98079
2025-12-05 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185613 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185613
2025-12-05 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 spider: auto1.es
2025-12-05 17:05:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 52b7e65f-dca2-50f5-a9d5-c7c589d4fc47 due to rule: high_mileage_for_country.json, error: 185613 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185613
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:26:03Z',
 'fuel_type': 'diesel',
 'id': '52b7e65f-dca2-50f5-a9d5-c7c589d4fc47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD98079',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 185613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_418ec047873536529951eec1c1c8be90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_e3e7ceb04d0df5a79bb2cf649d12b266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_cfffdc67c17d8fc01e43c45394b40118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4bc56161ca859b9b6ed780f5c9ecad8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_c77031afdc4e14e7c48c66d13121b4d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_4c859ee6f5a6357f2318edccd36ff1f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_003fda55e2e357e3033a7341bf03e5df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_adab069ca6f718a93353b672ee9bcc0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_8f0e04a3fee33e861471b84a03566d55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_489d4d99891d47067f7bdf903d80ba27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_bd867ef9a262d558a5be65ec4f597628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_d4dd2a993aaa1674dbaf44235268e076.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_772b1e98ffbe0021bea6f986262bafe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_5869beddee6d4c3476c323e41378e96b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_a396e9a82cc6e6f804353793bdb996ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7e65f-dca2-50f5-a9d5-c7c589d4fc47/52b7e65f-dca2-50f5-a9d5-c7c589d4fc47_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b713dcd161cc08fab5fefe64fbf35e1/pa/JD98079_7e59a8661a44485ca0421021f5015c1f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2018}
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD98079%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [auto1.es] INFO: Saving data for JD98079: {'created_time': 1764954306.54371, 'last_price_update_time': 1764954306.543724, 'auction_closing_time': 1765038363.0}
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JD98079') HTTP/1.1" 204 0
2025-12-05 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_9fbb458816deb08125380cfdbaabb252.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_0f2c15ba96225a63aa45a3382306f72f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0f2c15ba96225a63aa45a3382306f72f.jpg not downloaded yet
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB99040> (referer: https://www.auto1.com/v1/car-details-view/BB99040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR33039> (referer: https://www.auto1.com/v1/car-details-view/SR33039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL27489> (referer: https://www.auto1.com/v1/car-details-view/ZL27489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e77b950>
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_d3db0095906dc328180af869f5c1e711.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d3db0095906dc328180af869f5c1e711.jpg saved to cache
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c89d0>
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_1c6315985df4181aa23ae3ed422fd88d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1c6315985df4181aa23ae3ed422fd88d.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a7c50>
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_36c254a4a6174ce34cf1a07461f8fcf7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_36c254a4a6174ce34cf1a07461f8fcf7.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_7e125de82b1e4a05a95d0869254dd0d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_c88b780a058fec407352cd96d3194bae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_c88b780a058fec407352cd96d3194bae.jpg not downloaded yet
2025-12-05 17:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1993099-ffca-5dc2-a1c6-cd962427ced7 with identifier: KL74681
2025-12-05 17:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1993099-ffca-5dc2-a1c6-cd962427ced7 with scrape type 2
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1993099-ffca-5dc2-a1c6-cd962427ced7 with scrape type 2
2025-12-05 17:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1993099-ffca-5dc2-a1c6-cd962427ced7, identifier: KL74681
2025-12-05 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ75703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1993099-ffca-5dc2-a1c6-cd962427ced7 with identifier: KL74681
2025-12-05 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1993099-ffca-5dc2-a1c6-cd962427ced7 with identifier: KL74681
2025-12-05 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168177 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168177
2025-12-05 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d1993099-ffca-5dc2-a1c6-cd962427ced7 spider: auto1.es
2025-12-05 17:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d1993099-ffca-5dc2-a1c6-cd962427ced7 due to rule: high_mileage_for_country.json, error: 168177 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168177
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:11:42Z',
 'fuel_type': 'diesel',
 'id': 'd1993099-ffca-5dc2-a1c6-cd962427ced7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL74681',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 168177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL74681%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [auto1.es] INFO: Saving data for KL74681: {'auction_closing_time': 1765037502.0, 'created_time': 1762966974.469624, 'last_price_update_time': 1764954307.66554}
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL74681') HTTP/1.1" 204 0
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e825b90>
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_9fbb458816deb08125380cfdbaabb252.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_9fbb458816deb08125380cfdbaabb252.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d471b03-31da-58d4-87f6-f7d1d593bcc9 with identifier: BB99040
2025-12-05 17:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d471b03-31da-58d4-87f6-f7d1d593bcc9 with scrape type 2
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d471b03-31da-58d4-87f6-f7d1d593bcc9 with scrape type 2
2025-12-05 17:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1d471b03-31da-58d4-87f6-f7d1d593bcc9, identifier: BB99040
2025-12-05 17:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0248b0bb-9d0e-5def-b98b-0dfcebf93351 with identifier: SR33039
2025-12-05 17:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0248b0bb-9d0e-5def-b98b-0dfcebf93351 with scrape type 2
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0248b0bb-9d0e-5def-b98b-0dfcebf93351 with scrape type 2
2025-12-05 17:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0248b0bb-9d0e-5def-b98b-0dfcebf93351, identifier: SR33039
2025-12-05 17:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e471e58e-1f9d-56de-9892-98d8b440cbd1 with identifier: ZL27489
2025-12-05 17:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e471e58e-1f9d-56de-9892-98d8b440cbd1 with scrape type 2
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e471e58e-1f9d-56de-9892-98d8b440cbd1 with scrape type 2
2025-12-05 17:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e471e58e-1f9d-56de-9892-98d8b440cbd1, identifier: ZL27489
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_5f707d0ad513cb438036f0851db4ccdd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_5f707d0ad513cb438036f0851db4ccdd.jpg not downloaded yet
2025-12-05 17:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1d471b03-31da-58d4-87f6-f7d1d593bcc9 with identifier: BB99040
2025-12-05 17:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1d471b03-31da-58d4-87f6-f7d1d593bcc9 with identifier: BB99040
2025-12-05 17:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2025-12-05 17:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1d471b03-31da-58d4-87f6-f7d1d593bcc9 spider: auto1.es
2025-12-05 17:05:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1d471b03-31da-58d4-87f6-f7d1d593bcc9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:58:22Z',
 'fuel_type': 'diesel',
 'id': '1d471b03-31da-58d4-87f6-f7d1d593bcc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB99040',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 93753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB99040%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [auto1.es] INFO: Saving data for BB99040: {'auction_closing_time': 1765040302.0, 'created_time': 1762966975.610704, 'last_price_update_time': 1764954308.45844}
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB99040') HTTP/1.1" 204 0
2025-12-05 17:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0248b0bb-9d0e-5def-b98b-0dfcebf93351 with identifier: SR33039
2025-12-05 17:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0248b0bb-9d0e-5def-b98b-0dfcebf93351 with identifier: SR33039
2025-12-05 17:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0248b0bb-9d0e-5def-b98b-0dfcebf93351 with identifier: SR33039 to the API
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR33039>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:06:51Z',
 'fuel_type': 'diesel',
 'id': '0248b0bb-9d0e-5def-b98b-0dfcebf93351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR33039',
 'listing': 'auction',
 'location': 'ES',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 95296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.5 Blue-HDi Montmartre',
 'transmission': 'manual',
 'trim': 'Montmartre',
 'year': 2021}
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR33039%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [auto1.es] INFO: Saving data for SR33039: {'auction_closing_time': 1765037211.0, 'created_time': 1763571946.428588, 'last_price_update_time': 1764954310.730733}
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR33039') HTTP/1.1" 204 0
2025-12-05 17:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e471e58e-1f9d-56de-9892-98d8b440cbd1 with identifier: ZL27489
2025-12-05 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e471e58e-1f9d-56de-9892-98d8b440cbd1 with identifier: ZL27489
2025-12-05 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2025-12-05 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e471e58e-1f9d-56de-9892-98d8b440cbd1 spider: auto1.es
2025-12-05 17:05:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e471e58e-1f9d-56de-9892-98d8b440cbd1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-06T16:39:42Z',
 'fuel_type': 'electro',
 'id': 'e471e58e-1f9d-56de-9892-98d8b440cbd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL27489',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 31048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit electric drive 135 kW L3 Trend',
 'transmission': 'automatic',
 'trim': 'L3 Trend',
 'year': 2022}
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27489%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [auto1.es] INFO: Saving data for ZL27489: {'auction_closing_time': 1765039182.0, 'created_time': 1762448759.246618, 'last_price_update_time': 1764954310.955861}
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL27489') HTTP/1.1" 204 0
2025-12-05 17:05:10 [scrapy.extensions.logstats] INFO: Crawled 518 pages (at 107 pages/min), scraped 162 items (at 33 items/min)
2025-12-05 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC26234> (referer: https://www.auto1.com/v1/car-details-view/YC26234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4c78d0>
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_7e125de82b1e4a05a95d0869254dd0d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_7e125de82b1e4a05a95d0869254dd0d2.jpg saved to cache
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_f58a5ac1060d0480b48e4e4ded42515a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_b38072a34a7423380beacc22107fd582.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_1157791a8199df54bcfdaa7a099aec94.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1157791a8199df54bcfdaa7a099aec94.jpg not downloaded yet
2025-12-05 17:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS96341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_16710a3a3dcc1951356906a43a3218f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_16710a3a3dcc1951356906a43a3218f5.jpg not downloaded yet
2025-12-05 17:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de41b0d4-fbab-575b-99e3-86f43edc6c7a with identifier: YC26234
2025-12-05 17:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de41b0d4-fbab-575b-99e3-86f43edc6c7a with scrape type 2
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de41b0d4-fbab-575b-99e3-86f43edc6c7a with scrape type 2
2025-12-05 17:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de41b0d4-fbab-575b-99e3-86f43edc6c7a, identifier: YC26234
2025-12-05 17:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de41b0d4-fbab-575b-99e3-86f43edc6c7a with identifier: YC26234
2025-12-05 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de41b0d4-fbab-575b-99e3-86f43edc6c7a with identifier: YC26234
2025-12-05 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: de41b0d4-fbab-575b-99e3-86f43edc6c7a spider: auto1.es
2025-12-05 17:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: de41b0d4-fbab-575b-99e3-86f43edc6c7a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:37:49Z',
 'fuel_type': 'diesel',
 'id': 'de41b0d4-fbab-575b-99e3-86f43edc6c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC26234',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 160760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC26234%27 HTTP/1.1" 200 None
2025-12-05 17:05:11 [auto1.es] INFO: Saving data for YC26234: {'auction_closing_time': 1765039069.0, 'created_time': 1762967064.533093, 'last_price_update_time': 1764954311.556642}
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC26234') HTTP/1.1" 204 0
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_d322d1c8025bdb3f9377bb84e21a284e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d322d1c8025bdb3f9377bb84e21a284e.jpg not downloaded yet
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_c88b780a058fec407352cd96d3194bae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbda850>
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_f58a5ac1060d0480b48e4e4ded42515a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_f58a5ac1060d0480b48e4e4ded42515a.jpg saved to cache
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbda110>
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_b38072a34a7423380beacc22107fd582.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_b38072a34a7423380beacc22107fd582.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_5f707d0ad513cb438036f0851db4ccdd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0f2c15ba96225a63aa45a3382306f72f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_3f01615139f4ad62eb1c21432ab3c851.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_3f01615139f4ad62eb1c21432ab3c851.jpg not downloaded yet
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1157791a8199df54bcfdaa7a099aec94.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6fdd50>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_c88b780a058fec407352cd96d3194bae.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_c88b780a058fec407352cd96d3194bae.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_16710a3a3dcc1951356906a43a3218f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d322d1c8025bdb3f9377bb84e21a284e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW11228> (referer: https://www.auto1.com/v1/car-details-view/BW11228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e789ad0>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_5f707d0ad513cb438036f0851db4ccdd.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_5f707d0ad513cb438036f0851db4ccdd.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7c7010>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_0f2c15ba96225a63aa45a3382306f72f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0f2c15ba96225a63aa45a3382306f72f.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcca90>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_1157791a8199df54bcfdaa7a099aec94.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1157791a8199df54bcfdaa7a099aec94.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_3f01615139f4ad62eb1c21432ab3c851.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD16750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU13655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE80053> (referer: https://www.auto1.com/v1/car-details-view/NE80053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV26148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV19691> (referer: https://www.auto1.com/v1/car-details-view/ZV19691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5cf690>
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_16710a3a3dcc1951356906a43a3218f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_16710a3a3dcc1951356906a43a3218f5.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da86590>
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_d322d1c8025bdb3f9377bb84e21a284e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d322d1c8025bdb3f9377bb84e21a284e.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64681c1b-c643-51a7-8efd-3ed94847713d with identifier: BW11228
2025-12-05 17:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64681c1b-c643-51a7-8efd-3ed94847713d with scrape type 2
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64681c1b-c643-51a7-8efd-3ed94847713d with scrape type 2
2025-12-05 17:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 64681c1b-c643-51a7-8efd-3ed94847713d, identifier: BW11228
2025-12-05 17:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 64681c1b-c643-51a7-8efd-3ed94847713d with identifier: BW11228
2025-12-05 17:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 64681c1b-c643-51a7-8efd-3ed94847713d with identifier: BW11228
2025-12-05 17:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 64681c1b-c643-51a7-8efd-3ed94847713d with identifier: BW11228 to the API
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW11228>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:28:43Z',
 'fuel_type': 'diesel',
 'id': '64681c1b-c643-51a7-8efd-3ed94847713d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW11228',
 'listing': 'auction',
 'location': 'ES',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 135293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.5 Blue-HDi Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2021}
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW11228%27 HTTP/1.1" 200 None
2025-12-05 17:05:13 [auto1.es] INFO: Saving data for BW11228: {'auction_closing_time': 1765038523.0, 'created_time': 1762966976.813307, 'last_price_update_time': 1764954313.987367}
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BW11228') HTTP/1.1" 204 0
2025-12-05 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL01909> (referer: https://www.auto1.com/v1/car-details-view/CL01909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a5f90>
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F0a%252F510a70208afae8a4bcd03b240719885c%252Fpa%252FRJ98807_3f01615139f4ad62eb1c21432ab3c851.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_3f01615139f4ad62eb1c21432ab3c851.jpg saved to cache
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb
2025-12-05 17:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb, skipping ID generation
2025-12-05 17:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb with scrape type 1
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb from tracking dictionaries
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85d33294-8cca-58cc-8d33-dc4c2ddc94fb sending to next pipeline
2025-12-05 17:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb, identifier: RJ98807
2025-12-05 17:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1fb076-f235-5203-80c2-0237befe3640 with identifier: NE80053
2025-12-05 17:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1fb076-f235-5203-80c2-0237befe3640 with scrape type 2
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b1fb076-f235-5203-80c2-0237befe3640 with scrape type 2
2025-12-05 17:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b1fb076-f235-5203-80c2-0237befe3640, identifier: NE80053
2025-12-05 17:05:14 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691
2025-12-05 17:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with scrape type 2
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with scrape type 2
2025-12-05 17:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c, identifier: ZV19691
2025-12-05 17:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb with identifier: RJ98807
2025-12-05 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb with identifier: RJ98807
2025-12-05 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2025-12-05 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb spider: auto1.es
2025-12-05 17:05:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 85d33294-8cca-58cc-8d33-dc4c2ddc94fb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:08:43Z',
 'fuel_type': 'diesel',
 'id': '85d33294-8cca-58cc-8d33-dc4c2ddc94fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ98807',
 'listing': 'auction',
 'location': 'ES, León',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 137711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_39e150e43dddea988bf6721e44f9ad74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0de937096bfc79a615cd05731a658485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1c6315985df4181aa23ae3ed422fd88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d3db0095906dc328180af869f5c1e711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_36c254a4a6174ce34cf1a07461f8fcf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_7e125de82b1e4a05a95d0869254dd0d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_9fbb458816deb08125380cfdbaabb252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_b38072a34a7423380beacc22107fd582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_f58a5ac1060d0480b48e4e4ded42515a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_0f2c15ba96225a63aa45a3382306f72f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_c88b780a058fec407352cd96d3194bae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_5f707d0ad513cb438036f0851db4ccdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_1157791a8199df54bcfdaa7a099aec94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_16710a3a3dcc1951356906a43a3218f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_d322d1c8025bdb3f9377bb84e21a284e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d33294-8cca-58cc-8d33-dc4c2ddc94fb/85d33294-8cca-58cc-8d33-dc4c2ddc94fb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/0a/510a70208afae8a4bcd03b240719885c/pa/RJ98807_3f01615139f4ad62eb1c21432ab3c851.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ98807%27 HTTP/1.1" 200 None
2025-12-05 17:05:14 [auto1.es] INFO: Saving data for RJ98807: {'created_time': 1764954314.812592, 'last_price_update_time': 1764954314.812601, 'auction_closing_time': 1765037323.0}
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RJ98807') HTTP/1.1" 204 0
2025-12-05 17:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b1fb076-f235-5203-80c2-0237befe3640 with identifier: NE80053
2025-12-05 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b1fb076-f235-5203-80c2-0237befe3640 with identifier: NE80053
2025-12-05 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171327 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171327
2025-12-05 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4b1fb076-f235-5203-80c2-0237befe3640 spider: auto1.es
2025-12-05 17:05:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4b1fb076-f235-5203-80c2-0237befe3640 due to rule: high_mileage_for_country.json, error: 171327 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171327
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 225,
 'expiration_date': '2025-12-06T16:35:09Z',
 'fuel_type': 'hybrid',
 'id': '4b1fb076-f235-5203-80c2-0237befe3640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE80053',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'BMW',
 'model': '2er',
 'odometer': 171327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE80053%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Saving data for NE80053: {'auction_closing_time': 1765038909.0, 'created_time': 1764672274.927423, 'last_price_update_time': 1764954315.037194}
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NE80053') HTTP/1.1" 204 0
2025-12-05 17:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691
2025-12-05 17:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691
2025-12-05 17:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691 to the API
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV19691>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:25:15Z',
 'fuel_type': 'petrol',
 'id': '8e7f3d1e-d7f6-5667-a078-5c05b74ca88c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV19691',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 147473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV19691%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Saving data for ZV19691: {'auction_closing_time': 1765038315.0, 'created_time': 1760461444.259366, 'last_price_update_time': 1764954315.369931}
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV19691') HTTP/1.1" 204 0
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: UM11413
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM11413%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for UM11413: 0
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: AJ00657
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ00657%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for AJ00657: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: SU89258
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU89258%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for SU89258: 2
2025-12-05 17:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e832be-06b0-50da-87ca-87a33eb3edf0 with identifier: CL01909
2025-12-05 17:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e832be-06b0-50da-87ca-87a33eb3edf0 with scrape type 2
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e832be-06b0-50da-87ca-87a33eb3edf0 with scrape type 2
2025-12-05 17:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0e832be-06b0-50da-87ca-87a33eb3edf0, identifier: CL01909
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: GD96129
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD96129%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for GD96129: 1
2025-12-05 17:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0e832be-06b0-50da-87ca-87a33eb3edf0 with identifier: CL01909
2025-12-05 17:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0e832be-06b0-50da-87ca-87a33eb3edf0 with identifier: CL01909
2025-12-05 17:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2025-12-05 17:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a0e832be-06b0-50da-87ca-87a33eb3edf0 spider: auto1.es
2025-12-05 17:05:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a0e832be-06b0-50da-87ca-87a33eb3edf0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:07:26Z',
 'fuel_type': 'electro',
 'id': 'a0e832be-06b0-50da-87ca-87a33eb3edf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL01909',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 26150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Saving data for CL01909: {'auction_closing_time': 1765037246.0, 'created_time': 1762448801.715212, 'last_price_update_time': 1764954315.789008}
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL01909') HTTP/1.1" 204 0
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: RX68125
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX68125%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for RX68125: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: SB76266
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB76266%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for SB76266: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: XZ90079
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ90079%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for XZ90079: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: LZ73494
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ73494%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for LZ73494: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: AW56639
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW56639%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for AW56639: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: TY38096
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY38096%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for TY38096: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: UC20830
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC20830%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for UC20830: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: NR85149
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR85149%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for NR85149: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: XG14528
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG14528%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for XG14528: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: DX91885
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX91885%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for DX91885: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: RB64623
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB64623%27 HTTP/1.1" 200 None
2025-12-05 17:05:15 [auto1.es] INFO: Scrape type for RB64623: 2
2025-12-05 17:05:15 [auto1.es] INFO: Found listing with ID: LZ69467
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ69467%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for LZ69467: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: CS24104
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS24104%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for CS24104: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: LN60330
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN60330%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for LN60330: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: ZF50859
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF50859%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for ZF50859: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: EU50952
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU50952%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for EU50952: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: EN30281
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for EN30281: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: LP28290
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP28290%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for LP28290: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: YA94679
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA94679%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for YA94679: 1
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: DN26458
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN26458%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for DN26458: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: PS95415
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS95415%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for PS95415: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: VB62994
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB62994%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for VB62994: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: PK27651
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK27651%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for PK27651: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: JT67335
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT67335%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for JT67335: 1
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: GX28427
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX28427%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for GX28427: 1
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: EX26806
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX26806%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for EX26806: 1
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS96341> (referer: https://www.auto1.com/v1/car-details-view/FS96341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: CE36300
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE36300%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for CE36300: 1
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG82420> (referer: https://www.auto1.com/v1/car-details-view/SG82420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK88476> (referer: https://www.auto1.com/v1/car-details-view/ZK88476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: GR03905
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR03905%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for GR03905: 2
2025-12-05 17:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW60593> (referer: https://www.auto1.com/v1/car-details-view/TW60593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: CA66568
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA66568%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for CA66568: 2
2025-12-05 17:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: GF64516
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF64516%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for GF64516: 2
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: TS38549
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS38549%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for TS38549: 2
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR76643> (referer: https://www.auto1.com/v1/car-details-view/BR76643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: RK00839
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK00839%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for RK00839: 2
2025-12-05 17:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c with identifier: FS96341
2025-12-05 17:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c with scrape type 1
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_26d0d7261df937f2a2fbf29f778e8345.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_26d0d7261df937f2a2fbf29f778e8345.jpg not downloaded yet
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: SC18749
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC18749%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for SC18749: 2
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_c99b13323c6fe91e85fa545adeef1f23.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_c99b13323c6fe91e85fa545adeef1f23.jpg not downloaded yet
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: GU60335
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU60335%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for GU60335: 2
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_dc3771e9c8f7eca13def8f78e22c08af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_dc3771e9c8f7eca13def8f78e22c08af.jpg not downloaded yet
2025-12-05 17:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78e365c4-0caa-591e-a398-754665fc3902 with identifier: SG82420
2025-12-05 17:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78e365c4-0caa-591e-a398-754665fc3902 with scrape type 2
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78e365c4-0caa-591e-a398-754665fc3902 with scrape type 2
2025-12-05 17:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78e365c4-0caa-591e-a398-754665fc3902, identifier: SG82420
2025-12-05 17:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3d5252-a6ba-5eed-bc31-a2f072281453 with identifier: ZK88476
2025-12-05 17:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3d5252-a6ba-5eed-bc31-a2f072281453 with scrape type 2
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3d5252-a6ba-5eed-bc31-a2f072281453 with scrape type 2
2025-12-05 17:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a3d5252-a6ba-5eed-bc31-a2f072281453, identifier: ZK88476
2025-12-05 17:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2 with identifier: TW60593
2025-12-05 17:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2 with scrape type 2
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2 with scrape type 2
2025-12-05 17:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2, identifier: TW60593
2025-12-05 17:05:16 [auto1.es] INFO: Found listing with ID: SE87574
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE87574%27 HTTP/1.1" 200 None
2025-12-05 17:05:16 [auto1.es] INFO: Scrape type for SE87574: 2
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY29147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78e365c4-0caa-591e-a398-754665fc3902 with identifier: SG82420
2025-12-05 17:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78e365c4-0caa-591e-a398-754665fc3902 with identifier: SG82420
2025-12-05 17:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 12189, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg82420', 'expiration_date': '2025-12-06t16:21:03z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '78e365c4-0caa-591e-a398-754665fc3902', 'current_year_diff': 3, 'age_in_months': 40, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 12189}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 40,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:21:03z',
     'fuel_type': 'petrol',
     'id': '78e365c4-0caa-591e-a398-754665fc3902',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg82420',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 12189,
     'odometer_in_km': 12189,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-07-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2022}
2025-12-05 17:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 78e365c4-0caa-591e-a398-754665fc3902 spider: auto1.es
2025-12-05 17:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 78e365c4-0caa-591e-a398-754665fc3902 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 12189, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg82420', 'expiration_date': '2025-12-06t16:21:03z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '78e365c4-0caa-591e-a398-754665fc3902', 'current_year_diff': 3, 'age_in_months': 40, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 12189}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 40,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:21:03z',
     'fuel_type': 'petrol',
     'id': '78e365c4-0caa-591e-a398-754665fc3902',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg82420',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 12189,
     'odometer_in_km': 12189,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-07-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:21:03Z',
 'fuel_type': 'petrol',
 'id': '78e365c4-0caa-591e-a398-754665fc3902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG82420',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 12189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2022}
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG82420%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [auto1.es] INFO: Saving data for SG82420: {'auction_closing_time': 1765038063.0, 'created_time': 1763547475.488702, 'last_price_update_time': 1764954317.018119}
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG82420') HTTP/1.1" 204 0
2025-12-05 17:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a3d5252-a6ba-5eed-bc31-a2f072281453 with identifier: ZK88476
2025-12-05 17:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a3d5252-a6ba-5eed-bc31-a2f072281453 with identifier: ZK88476
2025-12-05 17:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a3d5252-a6ba-5eed-bc31-a2f072281453 with identifier: ZK88476 to the API
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK88476>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:34:21Z',
 'fuel_type': 'diesel',
 'id': '5a3d5252-a6ba-5eed-bc31-a2f072281453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK88476',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 110955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK88476%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [auto1.es] INFO: Saving data for ZK88476: {'auction_closing_time': 1765038861.0, 'created_time': 1762261091.694518, 'last_price_update_time': 1764954317.426058}
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK88476') HTTP/1.1" 204 0
2025-12-05 17:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2 with identifier: TW60593
2025-12-05 17:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2 with identifier: TW60593
2025-12-05 17:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9bfaa0b9-cb6e-5815-be60-63a1d2452ae2 with identifier: TW60593 to the API
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW60593>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2025-12-06T16:24:07Z',
 'fuel_type': 'petrol',
 'id': '9bfaa0b9-cb6e-5815-be60-63a1d2452ae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW60593',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '5er',
 'odometer': 112449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 540i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW60593%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [auto1.es] INFO: Saving data for TW60593: {'auction_closing_time': 1765038247.0, 'created_time': 1762347449.262762, 'last_price_update_time': 1764954317.76726}
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW60593') HTTP/1.1" 204 0
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_d6cbf94ab1b7360ff8b5f8bf00c72986.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_d6cbf94ab1b7360ff8b5f8bf00c72986.jpg not downloaded yet
2025-12-05 17:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:17 [auto1.es] INFO: Found listing with ID: UE14624
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE14624%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [auto1.es] INFO: Scrape type for UE14624: 2
2025-12-05 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ60930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ75703> (referer: https://www.auto1.com/v1/car-details-view/TZ75703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_217903c4b19474b57ac4c9d82509dacb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_217903c4b19474b57ac4c9d82509dacb.jpg not downloaded yet
2025-12-05 17:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7460ee56-9572-5eff-9c02-433af6349949 with identifier: BR76643
2025-12-05 17:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7460ee56-9572-5eff-9c02-433af6349949 with scrape type 2
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7460ee56-9572-5eff-9c02-433af6349949 with scrape type 2
2025-12-05 17:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7460ee56-9572-5eff-9c02-433af6349949, identifier: BR76643
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_a54bfded8ee7d0595986707f6f257767.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_a54bfded8ee7d0595986707f6f257767.jpg not downloaded yet
2025-12-05 17:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7460ee56-9572-5eff-9c02-433af6349949 with identifier: BR76643
2025-12-05 17:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7460ee56-9572-5eff-9c02-433af6349949 with identifier: BR76643
2025-12-05 17:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7460ee56-9572-5eff-9c02-433af6349949 with identifier: BR76643 to the API
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BR76643>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 213,
 'expiration_date': '2025-12-06T16:54:25Z',
 'fuel_type': 'hybrid',
 'id': '7460ee56-9572-5eff-9c02-433af6349949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR76643',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 9785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.5 VC-T e-POWER N-Connecta 4x4',
 'transmission': 'automatic',
 'trim': 'N-Connecta 4x4',
 'year': 2024}
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR76643%27 HTTP/1.1" 200 None
2025-12-05 17:05:18 [auto1.es] INFO: Saving data for BR76643: {'auction_closing_time': 1765040065.0, 'created_time': 1762880652.207039, 'last_price_update_time': 1764954318.291505}
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR76643') HTTP/1.1" 204 0
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_dc3771e9c8f7eca13def8f78e22c08af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_5532f2b31824076ca633a3fe216e937f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_5532f2b31824076ca633a3fe216e937f.jpg not downloaded yet
2025-12-05 17:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74d003b7-e23d-5871-869d-2e7231478771 with identifier: TZ75703
2025-12-05 17:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d003b7-e23d-5871-869d-2e7231478771 with scrape type 2
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74d003b7-e23d-5871-869d-2e7231478771 with scrape type 2
2025-12-05 17:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 74d003b7-e23d-5871-869d-2e7231478771, identifier: TZ75703
2025-12-05 17:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 74d003b7-e23d-5871-869d-2e7231478771 with identifier: TZ75703
2025-12-05 17:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 74d003b7-e23d-5871-869d-2e7231478771 with identifier: TZ75703
2025-12-05 17:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 74d003b7-e23d-5871-869d-2e7231478771 with identifier: TZ75703 to the API
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ75703>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:12:03Z',
 'fuel_type': 'petrol',
 'id': '74d003b7-e23d-5871-869d-2e7231478771',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ75703',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 20934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ75703%27 HTTP/1.1" 200 None
2025-12-05 17:05:18 [auto1.es] INFO: Saving data for TZ75703: {'auction_closing_time': 1765037523.0, 'created_time': 1764263143.293893, 'last_price_update_time': 1764954318.735741}
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TZ75703') HTTP/1.1" 204 0
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_d6cbf94ab1b7360ff8b5f8bf00c72986.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_1ad4f6d5f3c7490bf609652549b472ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_1ad4f6d5f3c7490bf609652549b472ea.jpg not downloaded yet
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_059b3cad654525fa7ee4d9210f6252eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_059b3cad654525fa7ee4d9210f6252eb.jpg not downloaded yet
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC81161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR71719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL29575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da73ed0>
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_dc3771e9c8f7eca13def8f78e22c08af.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_dc3771e9c8f7eca13def8f78e22c08af.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_a54bfded8ee7d0595986707f6f257767.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_ef6ae57ecfcf9a570a5666ecd8d80319.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_ef6ae57ecfcf9a570a5666ecd8d80319.jpg not downloaded yet
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM91287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690aeef10>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_d6cbf94ab1b7360ff8b5f8bf00c72986.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_d6cbf94ab1b7360ff8b5f8bf00c72986.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_f87e5a068d97903f1d6a929582fe86ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f87e5a068d97903f1d6a929582fe86ed.jpg not downloaded yet
2025-12-05 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_217903c4b19474b57ac4c9d82509dacb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_1ad4f6d5f3c7490bf609652549b472ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_5532f2b31824076ca633a3fe216e937f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_25d1bc73a6ae598e9f2f638e75623290.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_25d1bc73a6ae598e9f2f638e75623290.jpg not downloaded yet
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT52527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_96e9f314c0e40e367038ffa7b4e5e32c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_96e9f314c0e40e367038ffa7b4e5e32c.jpg not downloaded yet
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e78a410>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_a54bfded8ee7d0595986707f6f257767.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_a54bfded8ee7d0595986707f6f257767.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_ef6ae57ecfcf9a570a5666ecd8d80319.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_f3c400d9cc8a43f0b0ec0454989f5682.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f3c400d9cc8a43f0b0ec0454989f5682.jpg not downloaded yet
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW74431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e778410>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_217903c4b19474b57ac4c9d82509dacb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_217903c4b19474b57ac4c9d82509dacb.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e827510>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_1ad4f6d5f3c7490bf609652549b472ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_1ad4f6d5f3c7490bf609652549b472ea.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d89b3d0>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_5532f2b31824076ca633a3fe216e937f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_5532f2b31824076ca633a3fe216e937f.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_596dff9f8c770ff584263f99f772b72c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_596dff9f8c770ff584263f99f772b72c.jpg not downloaded yet
2025-12-05 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_25d1bc73a6ae598e9f2f638e75623290.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_095bd0f8a0db97d0865c55d6003f1f04.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_095bd0f8a0db97d0865c55d6003f1f04.jpg not downloaded yet
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY01455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX26806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX28427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE36300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV46847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbbbf10>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_ef6ae57ecfcf9a570a5666ecd8d80319.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_ef6ae57ecfcf9a570a5666ecd8d80319.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f3c400d9cc8a43f0b0ec0454989f5682.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbba0d0>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_25d1bc73a6ae598e9f2f638e75623290.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_25d1bc73a6ae598e9f2f638e75623290.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_059b3cad654525fa7ee4d9210f6252eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_96e9f314c0e40e367038ffa7b4e5e32c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_596dff9f8c770ff584263f99f772b72c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f87e5a068d97903f1d6a929582fe86ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR03905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS38549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da0a2d0>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_f3c400d9cc8a43f0b0ec0454989f5682.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f3c400d9cc8a43f0b0ec0454989f5682.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcc790>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_059b3cad654525fa7ee4d9210f6252eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_059b3cad654525fa7ee4d9210f6252eb.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db619d0>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_96e9f314c0e40e367038ffa7b4e5e32c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_96e9f314c0e40e367038ffa7b4e5e32c.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c3c10>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_596dff9f8c770ff584263f99f772b72c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_596dff9f8c770ff584263f99f772b72c.jpg saved to cache
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6fc510>
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_f87e5a068d97903f1d6a929582fe86ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f87e5a068d97903f1d6a929582fe86ed.jpg saved to cache
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_095bd0f8a0db97d0865c55d6003f1f04.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ60930> (referer: https://www.auto1.com/v1/car-details-view/TJ60930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY29147> (referer: https://www.auto1.com/v1/car-details-view/MY29147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbce090>
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_095bd0f8a0db97d0865c55d6003f1f04.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_095bd0f8a0db97d0865c55d6003f1f04.jpg saved to cache
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72822491-0771-50fe-81b5-65402a31fbbb with identifier: TJ60930
2025-12-05 17:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72822491-0771-50fe-81b5-65402a31fbbb with scrape type 1
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_d7e83bb309eb32bfcca80635a8328489.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_d7e83bb309eb32bfcca80635a8328489.jpg not downloaded yet
2025-12-05 17:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147
2025-12-05 17:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a476f0e2-54a0-5b2e-989e-2d96b48e475a with scrape type 1
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_48bc008ee87f40e114152bd0dc67af96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_48bc008ee87f40e114152bd0dc67af96.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_3b87ec1c9862964167e1b309f9af09b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_3b87ec1c9862964167e1b309f9af09b3.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_f06a2939af062fe8ef148acd52d1ef1a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_f06a2939af062fe8ef148acd52d1ef1a.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_afac159579296fb84214e3ad367334db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_afac159579296fb84214e3ad367334db.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_009f824788b61a2ac3c54c2383864e88.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_009f824788b61a2ac3c54c2383864e88.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_6deedbb32319dd2ca25743c1161f05f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_6deedbb32319dd2ca25743c1161f05f2.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_c8def60a2f81ccdaedec1b1955d672c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_c8def60a2f81ccdaedec1b1955d672c4.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_eb62cb3301545a6a6a2bfe19854d677a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_eb62cb3301545a6a6a2bfe19854d677a.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_293b3106bed2b3f3b41e8993b5c29fb8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_293b3106bed2b3f3b41e8993b5c29fb8.jpg not downloaded yet
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_e05dfd18966f2d1aa9898101b0d32aa0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_e05dfd18966f2d1aa9898101b0d32aa0.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_dede6288b2e413d755e8b57072d86d02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_dede6288b2e413d755e8b57072d86d02.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_9936561f3032d8acb194a1483d164aa6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9936561f3032d8acb194a1483d164aa6.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_23632a8691014a96a3559f56f37c5f44.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_23632a8691014a96a3559f56f37c5f44.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_db598746e6bcfff397129da371a0549b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_db598746e6bcfff397129da371a0549b.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_97371ae9f09ddf97e6c1e58ae3f2db2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_97371ae9f09ddf97e6c1e58ae3f2db2e.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_4a0962e24a325d8ccb18728c3c698eab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_4a0962e24a325d8ccb18728c3c698eab.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_e6b5748e4a4ab345f9fdc90d1deff5fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e6b5748e4a4ab345f9fdc90d1deff5fc.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_bd71ecc20343128ec408fec7f8cfe30d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_bd71ecc20343128ec408fec7f8cfe30d.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_d30370326313146de389ec82ae37140b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d30370326313146de389ec82ae37140b.jpg not downloaded yet
2025-12-05 17:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC81161> (referer: https://www.auto1.com/v1/car-details-view/DC81161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_15640650f8baa3869aa12c3a53459bb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_15640650f8baa3869aa12c3a53459bb1.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_d00981b5c6838b2ca16d5afe4d7d601a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d00981b5c6838b2ca16d5afe4d7d601a.jpg not downloaded yet
2025-12-05 17:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_ca8fd0b71844cd9ee4d4fa2305851531.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_ca8fd0b71844cd9ee4d4fa2305851531.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_e54df78c335b0d293ebdeaf405d5ac58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e54df78c335b0d293ebdeaf405d5ac58.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_9a87c5d83810ec8bbdb1ed88e07f6bf6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9a87c5d83810ec8bbdb1ed88e07f6bf6.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_ac730153b74133767b8830ae1e214577.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_ac730153b74133767b8830ae1e214577.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_68ce0067985e91b6d4a35a5fc6f7bc42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_68ce0067985e91b6d4a35a5fc6f7bc42.jpg not downloaded yet
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_bbb4a0a6a8077ff43eb9d22e63c72698.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_bbb4a0a6a8077ff43eb9d22e63c72698.jpg not downloaded yet
2025-12-05 17:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a with identifier: DC81161
2025-12-05 17:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a with scrape type 1
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_61562a6b4f8f32f7afd658032e7de115.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_61562a6b4f8f32f7afd658032e7de115.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_fcc1ac777ef59bb09c4e59cf27012883.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_fcc1ac777ef59bb09c4e59cf27012883.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_9cbb2c7c79fd1ade7def8c6d176a3694.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_9cbb2c7c79fd1ade7def8c6d176a3694.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_7fee7865279ab61f70609ae096fc12c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_7fee7865279ab61f70609ae096fc12c9.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_0f7f05b11113c2d3689280af6dbe580a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_0f7f05b11113c2d3689280af6dbe580a.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_26e8e88f595e576f90673d4adf918dc3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_26e8e88f595e576f90673d4adf918dc3.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_9973ad345a99d819946054d0bea25cef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_9973ad345a99d819946054d0bea25cef.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_d1672f413bbf775212bac7d16b4c7124.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_d1672f413bbf775212bac7d16b4c7124.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_a7d9741f3d0c3612d2952b1c273cf7b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_a7d9741f3d0c3612d2952b1c273cf7b7.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_b5ffb3915b68e9cf8cd3ce9cc932c60d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_b5ffb3915b68e9cf8cd3ce9cc932c60d.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_2d4d492652b7bb03304e89921d6d924e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_2d4d492652b7bb03304e89921d6d924e.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_1215ab4b4efa5cccf85f5e2ef0a06abf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_1215ab4b4efa5cccf85f5e2ef0a06abf.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_26263f2243849d45bb9c2bbc252238a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_26263f2243849d45bb9c2bbc252238a2.jpg already downloaded
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F32%252Fab32fa76875edbcb5c33c2da0bf45ffc%252Fpa%252FDC81161_633e3b7d94a82c371490df5b916448aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_633e3b7d94a82c371490df5b916448aa.jpg already downloaded
2025-12-05 17:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a, identifier: DC81161
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_909de5b2c82402a018988e330feb514b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_909de5b2c82402a018988e330feb514b.jpg not downloaded yet
2025-12-05 17:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a with identifier: DC81161
2025-12-05 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a with identifier: DC81161
2025-12-05 17:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a with identifier: DC81161 to the API
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC81161>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:43:47Z',
 'fuel_type': 'petrol',
 'id': 'e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC81161',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'Fiat',
 'model': '500',
 'odometer': 68788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_61562a6b4f8f32f7afd658032e7de115.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_fcc1ac777ef59bb09c4e59cf27012883.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_9cbb2c7c79fd1ade7def8c6d176a3694.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_7fee7865279ab61f70609ae096fc12c9.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_0f7f05b11113c2d3689280af6dbe580a.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_26e8e88f595e576f90673d4adf918dc3.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_9973ad345a99d819946054d0bea25cef.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_d1672f413bbf775212bac7d16b4c7124.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_a7d9741f3d0c3612d2952b1c273cf7b7.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_b5ffb3915b68e9cf8cd3ce9cc932c60d.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_2d4d492652b7bb03304e89921d6d924e.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_1215ab4b4efa5cccf85f5e2ef0a06abf.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_26263f2243849d45bb9c2bbc252238a2.jpg',
                'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_633e3b7d94a82c371490df5b916448aa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_61562a6b4f8f32f7afd658032e7de115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_fcc1ac777ef59bb09c4e59cf27012883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_9cbb2c7c79fd1ade7def8c6d176a3694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_7fee7865279ab61f70609ae096fc12c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_0f7f05b11113c2d3689280af6dbe580a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_26e8e88f595e576f90673d4adf918dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_9973ad345a99d819946054d0bea25cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_d1672f413bbf775212bac7d16b4c7124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_a7d9741f3d0c3612d2952b1c273cf7b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_b5ffb3915b68e9cf8cd3ce9cc932c60d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_2d4d492652b7bb03304e89921d6d924e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_1215ab4b4efa5cccf85f5e2ef0a06abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_26263f2243849d45bb9c2bbc252238a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a/e6a02c9f-4f11-5e47-ab8f-c01bd20b1d1a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/32/ab32fa76875edbcb5c33c2da0bf45ffc/pa/DC81161_633e3b7d94a82c371490df5b916448aa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC81161%27 HTTP/1.1" 200 None
2025-12-05 17:05:24 [auto1.es] INFO: Saving data for DC81161: {'created_time': 1764954324.180181, 'last_price_update_time': 1764954324.180199, 'auction_closing_time': 1765039427.0}
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DC81161') HTTP/1.1" 204 0
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d30370326313146de389ec82ae37140b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE87574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW74431> (referer: https://www.auto1.com/v1/car-details-view/CW74431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR71719> (referer: https://www.auto1.com/v1/car-details-view/YR71719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc26210>
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_d30370326313146de389ec82ae37140b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d30370326313146de389ec82ae37140b.jpg saved to cache
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf33c01-13a4-54ab-bd19-b75489e48be3 with identifier: CW74431
2025-12-05 17:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf33c01-13a4-54ab-bd19-b75489e48be3 with scrape type 2
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf33c01-13a4-54ab-bd19-b75489e48be3 with scrape type 2
2025-12-05 17:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cf33c01-13a4-54ab-bd19-b75489e48be3, identifier: CW74431
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_909de5b2c82402a018988e330feb514b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_ac730153b74133767b8830ae1e214577.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_bbb4a0a6a8077ff43eb9d22e63c72698.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_68ce0067985e91b6d4a35a5fc6f7bc42.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cf33c01-13a4-54ab-bd19-b75489e48be3 with identifier: CW74431
2025-12-05 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cf33c01-13a4-54ab-bd19-b75489e48be3 with identifier: CW74431
2025-12-05 17:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cf33c01-13a4-54ab-bd19-b75489e48be3 with identifier: CW74431 to the API
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW74431>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:47:28Z',
 'fuel_type': 'petrol',
 'id': '9cf33c01-13a4-54ab-bd19-b75489e48be3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW74431',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 30311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2022}
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW74431%27 HTTP/1.1" 200 None
2025-12-05 17:05:24 [auto1.es] INFO: Saving data for CW74431: {'auction_closing_time': 1765039648.0, 'created_time': 1764240262.974478, 'last_price_update_time': 1764954324.994431}
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CW74431') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719
2025-12-05 17:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e033c467-e410-5ad2-a05c-260b031feb8a with scrape type 1
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_713171f80a634f497aada3ba567a3ad8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_713171f80a634f497aada3ba567a3ad8.jpg not downloaded yet
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_5f020de0a013fa166d308801db751902.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_5f020de0a013fa166d308801db751902.jpg not downloaded yet
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d86c290>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_909de5b2c82402a018988e330feb514b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_909de5b2c82402a018988e330feb514b.jpg saved to cache
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d904290>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_ac730153b74133767b8830ae1e214577.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_ac730153b74133767b8830ae1e214577.jpg saved to cache
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e65a850>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_bbb4a0a6a8077ff43eb9d22e63c72698.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_bbb4a0a6a8077ff43eb9d22e63c72698.jpg saved to cache
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e43f050>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_68ce0067985e91b6d4a35a5fc6f7bc42.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_68ce0067985e91b6d4a35a5fc6f7bc42.jpg saved to cache
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_e9f1083601669a05d4c5ac8eac9a9a01.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e9f1083601669a05d4c5ac8eac9a9a01.jpg not downloaded yet
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_ca8fd0b71844cd9ee4d4fa2305851531.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d00981b5c6838b2ca16d5afe4d7d601a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9a87c5d83810ec8bbdb1ed88e07f6bf6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e54df78c335b0d293ebdeaf405d5ac58.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_c814128ec2171e789d4989381aa1c0e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_c814128ec2171e789d4989381aa1c0e0.jpg not downloaded yet
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE36300> (referer: https://www.auto1.com/v1/car-details-view/CE36300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT52527> (referer: https://www.auto1.com/v1/car-details-view/RT52527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX26806> (referer: https://www.auto1.com/v1/car-details-view/EX26806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX28427> (referer: https://www.auto1.com/v1/car-details-view/GX28427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM91287> (referer: https://www.auto1.com/v1/car-details-view/NM91287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV46847> (referer: https://www.auto1.com/v1/car-details-view/LV46847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL29575> (referer: https://www.auto1.com/v1/car-details-view/VL29575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_e4a6bbb7816d510a3ac87a998a7e8ab7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e4a6bbb7816d510a3ac87a998a7e8ab7.jpg not downloaded yet
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_9846cdef272001282c8320d76d7498b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_9846cdef272001282c8320d76d7498b3.jpg not downloaded yet
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_6ab63e4a198efc5de93d00a806f95b1a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_6ab63e4a198efc5de93d00a806f95b1a.jpg not downloaded yet
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_175af7ac42eb1404924615c7b3d115b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_175af7ac42eb1404924615c7b3d115b2.jpg not downloaded yet
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_713171f80a634f497aada3ba567a3ad8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_f6ef089435e1948894db6ffdf1521d74.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_f6ef089435e1948894db6ffdf1521d74.jpg not downloaded yet
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_15640650f8baa3869aa12c3a53459bb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e459750>
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_ca8fd0b71844cd9ee4d4fa2305851531.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_ca8fd0b71844cd9ee4d4fa2305851531.jpg saved to cache
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_bd71ecc20343128ec408fec7f8cfe30d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_67a3a980f8cc8a29fb4779337ebd74c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_67a3a980f8cc8a29fb4779337ebd74c5.jpg not downloaded yet
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e9f1083601669a05d4c5ac8eac9a9a01.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_4a0962e24a325d8ccb18728c3c698eab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbf35d0>
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_d00981b5c6838b2ca16d5afe4d7d601a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d00981b5c6838b2ca16d5afe4d7d601a.jpg saved to cache
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66906dc110>
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_9a87c5d83810ec8bbdb1ed88e07f6bf6.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9a87c5d83810ec8bbdb1ed88e07f6bf6.jpg saved to cache
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da16b50>
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_e54df78c335b0d293ebdeaf405d5ac58.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e54df78c335b0d293ebdeaf405d5ac58.jpg saved to cache
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_5f020de0a013fa166d308801db751902.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_97371ae9f09ddf97e6c1e58ae3f2db2e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e6b5748e4a4ab345f9fdc90d1deff5fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_0c5dcc8978b99647ed83a6de8f8dad7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0c5dcc8978b99647ed83a6de8f8dad7f.jpg not downloaded yet
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 with identifier: CE36300
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 with scrape type 1
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_a7305c1e633cc955f24e5b876a2bf8f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_a7305c1e633cc955f24e5b876a2bf8f2.jpg not downloaded yet
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd with identifier: RT52527
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd with scrape type 1
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_cd3f4d775265b5a3eb87ad5dc2fb2827.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_cd3f4d775265b5a3eb87ad5dc2fb2827.jpg not downloaded yet
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09820add-9e4e-5c08-8c8f-029cde42db59 with identifier: EX26806
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09820add-9e4e-5c08-8c8f-029cde42db59 with scrape type 1
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_e967a34dfc5eeca05956bd0e662fade0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_e967a34dfc5eeca05956bd0e662fade0.jpg not downloaded yet
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 467fd62d-375c-52f5-ad66-41b9bb894099 with identifier: GX28427
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 467fd62d-375c-52f5-ad66-41b9bb894099 with scrape type 1
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_83dcbd106f3dcf08558d1bf2aea23c10.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83dcbd106f3dcf08558d1bf2aea23c10.jpg not downloaded yet
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00cfe8fc-644a-5ae4-af00-db9de300a11a with identifier: NM91287
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00cfe8fc-644a-5ae4-af00-db9de300a11a with scrape type 2
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00cfe8fc-644a-5ae4-af00-db9de300a11a with scrape type 2
2025-12-05 17:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00cfe8fc-644a-5ae4-af00-db9de300a11a, identifier: NM91287
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fe6064-bb92-50c4-8755-de8f6a55aba8 with identifier: LV46847
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fe6064-bb92-50c4-8755-de8f6a55aba8 with scrape type 1
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 09fe6064-bb92-50c4-8755-de8f6a55aba8
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_ac634e68936cff0c29a97a3864f1239c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_ac634e68936cff0c29a97a3864f1239c.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_6da5ea490d99286d6354058d11a76680.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_6da5ea490d99286d6354058d11a76680.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_0ef0c34f050cfa3228a7dbf93c4338b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_0ef0c34f050cfa3228a7dbf93c4338b3.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_5fb55dfce73c057eeafdcff0cd8217ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_5fb55dfce73c057eeafdcff0cd8217ab.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_88e18db29e829d14dc59583ddab1e02d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_88e18db29e829d14dc59583ddab1e02d.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_54ebb99a44aa789012f7afd68816f53c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_54ebb99a44aa789012f7afd68816f53c.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_d2c16e78631555885feca94610eb4a69.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_d2c16e78631555885feca94610eb4a69.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_f158360fc76c6443574a46746a64ad4b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_f158360fc76c6443574a46746a64ad4b.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_280250ca3942b5704a5258596a4881c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_280250ca3942b5704a5258596a4881c1.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_7890804d8fe0a7951f17dfb7182eeed7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_7890804d8fe0a7951f17dfb7182eeed7.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_84eb068735eb8a88e592bd510b507d8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_84eb068735eb8a88e592bd510b507d8f.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_3fec31d3da84d5ecdbcb007eca7f71b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_3fec31d3da84d5ecdbcb007eca7f71b3.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_f1c8af28ef12ecdb6a217d0a624b752b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_f1c8af28ef12ecdb6a217d0a624b752b.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_cdcafcf89c47e542bf21f34150260d8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_cdcafcf89c47e542bf21f34150260d8b.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_c2b589215c916031241e0a410bb19feb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_c2b589215c916031241e0a410bb19feb.jpg already downloaded
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F8b%252F598b13c9e8fb027dda848081043f092a%252Fpa%252FLV46847_20b5536815b5bea77c5b503af952631b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_20b5536815b5bea77c5b503af952631b.jpg already downloaded
2025-12-05 17:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09fe6064-bb92-50c4-8755-de8f6a55aba8, identifier: LV46847
2025-12-05 17:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a3e987-d445-5bd3-aec9-c9f62d7f607b with identifier: VL29575
2025-12-05 17:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a3e987-d445-5bd3-aec9-c9f62d7f607b with scrape type 2
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02a3e987-d445-5bd3-aec9-c9f62d7f607b with scrape type 2
2025-12-05 17:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 02a3e987-d445-5bd3-aec9-c9f62d7f607b, identifier: VL29575
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5f9290>
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_713171f80a634f497aada3ba567a3ad8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_713171f80a634f497aada3ba567a3ad8.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e69ae50>
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_15640650f8baa3869aa12c3a53459bb1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_15640650f8baa3869aa12c3a53459bb1.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_db598746e6bcfff397129da371a0549b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_23632a8691014a96a3559f56f37c5f44.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_d5800a225d3ee6eec3c38d5026a9e87c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d5800a225d3ee6eec3c38d5026a9e87c.jpg not downloaded yet
2025-12-05 17:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00cfe8fc-644a-5ae4-af00-db9de300a11a with identifier: NM91287
2025-12-05 17:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00cfe8fc-644a-5ae4-af00-db9de300a11a with identifier: NM91287
2025-12-05 17:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145206 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145206
2025-12-05 17:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 00cfe8fc-644a-5ae4-af00-db9de300a11a spider: auto1.es
2025-12-05 17:05:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 00cfe8fc-644a-5ae4-af00-db9de300a11a due to rule: high_mileage_for_make.json, error: 145206 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145206
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-06T16:53:39Z',
 'fuel_type': 'petrol',
 'id': '00cfe8fc-644a-5ae4-af00-db9de300a11a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM91287',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 145206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM91287%27 HTTP/1.1" 200 None
2025-12-05 17:05:28 [auto1.es] INFO: Saving data for NM91287: {'auction_closing_time': 1765040019.0, 'created_time': 1764003921.583231, 'last_price_update_time': 1764954328.750879}
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM91287') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09fe6064-bb92-50c4-8755-de8f6a55aba8 with identifier: LV46847
2025-12-05 17:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09fe6064-bb92-50c4-8755-de8f6a55aba8 with identifier: LV46847
2025-12-05 17:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 09fe6064-bb92-50c4-8755-de8f6a55aba8 with identifier: LV46847 to the API
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LV46847>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-06T16:52:52Z',
 'fuel_type': 'diesel',
 'id': '09fe6064-bb92-50c4-8755-de8f6a55aba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV46847',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 124512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_ac634e68936cff0c29a97a3864f1239c.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_6da5ea490d99286d6354058d11a76680.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_0ef0c34f050cfa3228a7dbf93c4338b3.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_5fb55dfce73c057eeafdcff0cd8217ab.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_88e18db29e829d14dc59583ddab1e02d.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_54ebb99a44aa789012f7afd68816f53c.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_d2c16e78631555885feca94610eb4a69.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_f158360fc76c6443574a46746a64ad4b.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_280250ca3942b5704a5258596a4881c1.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_7890804d8fe0a7951f17dfb7182eeed7.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_84eb068735eb8a88e592bd510b507d8f.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_3fec31d3da84d5ecdbcb007eca7f71b3.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_f1c8af28ef12ecdb6a217d0a624b752b.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_cdcafcf89c47e542bf21f34150260d8b.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_c2b589215c916031241e0a410bb19feb.jpg',
                'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_20b5536815b5bea77c5b503af952631b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_ac634e68936cff0c29a97a3864f1239c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_6da5ea490d99286d6354058d11a76680.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_0ef0c34f050cfa3228a7dbf93c4338b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_5fb55dfce73c057eeafdcff0cd8217ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_88e18db29e829d14dc59583ddab1e02d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_54ebb99a44aa789012f7afd68816f53c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_d2c16e78631555885feca94610eb4a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_f158360fc76c6443574a46746a64ad4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_280250ca3942b5704a5258596a4881c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_7890804d8fe0a7951f17dfb7182eeed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_84eb068735eb8a88e592bd510b507d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_3fec31d3da84d5ecdbcb007eca7f71b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_f1c8af28ef12ecdb6a217d0a624b752b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_cdcafcf89c47e542bf21f34150260d8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_c2b589215c916031241e0a410bb19feb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09fe6064-bb92-50c4-8755-de8f6a55aba8/09fe6064-bb92-50c4-8755-de8f6a55aba8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/8b/598b13c9e8fb027dda848081043f092a/pa/LV46847_20b5536815b5bea77c5b503af952631b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2016}
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV46847%27 HTTP/1.1" 200 None
2025-12-05 17:05:29 [auto1.es] INFO: Saving data for LV46847: {'created_time': 1764954329.082714, 'last_price_update_time': 1764954329.082726, 'auction_closing_time': 1765039972.0}
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV46847') HTTP/1.1" 204 0
2025-12-05 17:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 02a3e987-d445-5bd3-aec9-c9f62d7f607b with identifier: VL29575
2025-12-05 17:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 02a3e987-d445-5bd3-aec9-c9f62d7f607b with identifier: VL29575
2025-12-05 17:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 02a3e987-d445-5bd3-aec9-c9f62d7f607b spider: auto1.es
2025-12-05 17:05:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 02a3e987-d445-5bd3-aec9-c9f62d7f607b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:50:59Z',
 'fuel_type': 'petrol',
 'id': '02a3e987-d445-5bd3-aec9-c9f62d7f607b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL29575',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 90169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL29575%27 HTTP/1.1" 200 None
2025-12-05 17:05:29 [auto1.es] INFO: Saving data for VL29575: {'auction_closing_time': 1765039859.0, 'created_time': 1763704897.895559, 'last_price_update_time': 1764954329.309471}
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL29575') HTTP/1.1" 204 0
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6b85d0>
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_bd71ecc20343128ec408fec7f8cfe30d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_bd71ecc20343128ec408fec7f8cfe30d.jpg saved to cache
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c3890>
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_e9f1083601669a05d4c5ac8eac9a9a01.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e9f1083601669a05d4c5ac8eac9a9a01.jpg saved to cache
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d98f110>
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_4a0962e24a325d8ccb18728c3c698eab.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_4a0962e24a325d8ccb18728c3c698eab.jpg saved to cache
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_6ab63e4a198efc5de93d00a806f95b1a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_9846cdef272001282c8320d76d7498b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_5de11d1e76f9d47e3953e9448a177e01.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_5de11d1e76f9d47e3953e9448a177e01.jpg not downloaded yet
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_af07da0c02c2cae7d8b6d829674e2ad7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_af07da0c02c2cae7d8b6d829674e2ad7.jpg not downloaded yet
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_a62fd5a21bdcd3a85fc3274c2c8430cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_a62fd5a21bdcd3a85fc3274c2c8430cd.jpg not downloaded yet
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_aa4bbf58d950e794386d5e9c376f74c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_aa4bbf58d950e794386d5e9c376f74c8.jpg not downloaded yet
2025-12-05 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_67a3a980f8cc8a29fb4779337ebd74c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_f6ef089435e1948894db6ffdf1521d74.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_175af7ac42eb1404924615c7b3d115b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e4a6bbb7816d510a3ac87a998a7e8ab7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_395c6e16f41dd34433910a2d399583ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_395c6e16f41dd34433910a2d399583ee.jpg not downloaded yet
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfb650>
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_5f020de0a013fa166d308801db751902.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_5f020de0a013fa166d308801db751902.jpg saved to cache
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8f8cd0>
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_97371ae9f09ddf97e6c1e58ae3f2db2e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_97371ae9f09ddf97e6c1e58ae3f2db2e.jpg saved to cache
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f9ed0>
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_e6b5748e4a4ab345f9fdc90d1deff5fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e6b5748e4a4ab345f9fdc90d1deff5fc.jpg saved to cache
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_bf8d2f4857772c6bc7638f1296205859.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_bf8d2f4857772c6bc7638f1296205859.jpg not downloaded yet
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_bb320cda29ec782ac656ee10ee08325a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_bb320cda29ec782ac656ee10ee08325a.jpg not downloaded yet
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_04b616a821fcc279735401e847178cae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_04b616a821fcc279735401e847178cae.jpg not downloaded yet
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_81a1ad10d1f02abdea8df4f628221fda.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_81a1ad10d1f02abdea8df4f628221fda.jpg not downloaded yet
2025-12-05 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE14624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e43eb50>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_db598746e6bcfff397129da371a0549b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_db598746e6bcfff397129da371a0549b.jpg saved to cache
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5fe790>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_23632a8691014a96a3559f56f37c5f44.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_23632a8691014a96a3559f56f37c5f44.jpg saved to cache
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_c814128ec2171e789d4989381aa1c0e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0c5dcc8978b99647ed83a6de8f8dad7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_d60084e5ef531c594400273f9d93a6df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d60084e5ef531c594400273f9d93a6df.jpg not downloaded yet
2025-12-05 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9936561f3032d8acb194a1483d164aa6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_dede6288b2e413d755e8b57072d86d02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_4c1009ee3f5d185ce6d54e98c56330cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_4c1009ee3f5d185ce6d54e98c56330cf.jpg not downloaded yet
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_0c77b3c7e49593352a0034da56486432.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_0c77b3c7e49593352a0034da56486432.jpg not downloaded yet
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_07c4eaaedb53366b3ab81653dd249251.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_07c4eaaedb53366b3ab81653dd249251.jpg not downloaded yet
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_8b9759cd31e95f6c1c29fb853d8c867d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_8b9759cd31e95f6c1c29fb853d8c867d.jpg not downloaded yet
2025-12-05 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE87574> (referer: https://www.auto1.com/v1/car-details-view/SE87574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669062a890>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_6ab63e4a198efc5de93d00a806f95b1a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_6ab63e4a198efc5de93d00a806f95b1a.jpg saved to cache
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe9250>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_9846cdef272001282c8320d76d7498b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_9846cdef272001282c8320d76d7498b3.jpg saved to cache
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d92d050>
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_67a3a980f8cc8a29fb4779337ebd74c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_67a3a980f8cc8a29fb4779337ebd74c5.jpg saved to cache
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fcc90>
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_f6ef089435e1948894db6ffdf1521d74.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_f6ef089435e1948894db6ffdf1521d74.jpg saved to cache
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d92dad0>
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_175af7ac42eb1404924615c7b3d115b2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_175af7ac42eb1404924615c7b3d115b2.jpg saved to cache
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8401d0>
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_e4a6bbb7816d510a3ac87a998a7e8ab7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e4a6bbb7816d510a3ac87a998a7e8ab7.jpg saved to cache
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83dcbd106f3dcf08558d1bf2aea23c10.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_e967a34dfc5eeca05956bd0e662fade0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_0435032dccd8e3724b8e1ce1a94949cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0435032dccd8e3724b8e1ce1a94949cf.jpg not downloaded yet
2025-12-05 17:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY01455> (referer: https://www.auto1.com/v1/car-details-view/TY01455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_cd3f4d775265b5a3eb87ad5dc2fb2827.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d5800a225d3ee6eec3c38d5026a9e87c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_cb613374dc09e4cac1f08f5cd1c2bd51.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_cb613374dc09e4cac1f08f5cd1c2bd51.jpg not downloaded yet
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_6342aa6d9cbc8b14773e6e35a31890e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_6342aa6d9cbc8b14773e6e35a31890e1.jpg not downloaded yet
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_d500e8e0de2f29a08b57ae5c658adbf4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d500e8e0de2f29a08b57ae5c658adbf4.jpg not downloaded yet
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_dcf9ffb8b71fe3290737020f7622e1d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dcf9ffb8b71fe3290737020f7622e1d1.jpg not downloaded yet
2025-12-05 17:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU60335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7581d0>
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_c814128ec2171e789d4989381aa1c0e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_c814128ec2171e789d4989381aa1c0e0.jpg saved to cache
2025-12-05 17:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c2e50>
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_0c5dcc8978b99647ed83a6de8f8dad7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0c5dcc8978b99647ed83a6de8f8dad7f.jpg saved to cache
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_e05dfd18966f2d1aa9898101b0d32aa0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_a7305c1e633cc955f24e5b876a2bf8f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_395c6e16f41dd34433910a2d399583ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_2af18950e7f6a52dd225dce2ece36e14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_2af18950e7f6a52dd225dce2ece36e14.jpg not downloaded yet
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR03905> (referer: https://www.auto1.com/v1/car-details-view/GR03905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5741d0>
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_9936561f3032d8acb194a1483d164aa6.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9936561f3032d8acb194a1483d164aa6.jpg saved to cache
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061aad0>
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_dede6288b2e413d755e8b57072d86d02.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_dede6288b2e413d755e8b57072d86d02.jpg saved to cache
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a09aa33-c858-563f-92dc-a92f05ae1a90 with identifier: SE87574
2025-12-05 17:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a09aa33-c858-563f-92dc-a92f05ae1a90 with scrape type 2
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a09aa33-c858-563f-92dc-a92f05ae1a90 with scrape type 2
2025-12-05 17:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a09aa33-c858-563f-92dc-a92f05ae1a90, identifier: SE87574
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_f14888787fe55788a378c35b193e5ede.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_f14888787fe55788a378c35b193e5ede.jpg not downloaded yet
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg not downloaded yet
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_2136574e7ab1a78e5d1175ab2e1a6f34.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_2136574e7ab1a78e5d1175ab2e1a6f34.jpg not downloaded yet
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_3fa44445a48fc375c09ceff562618778.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_3fa44445a48fc375c09ceff562618778.jpg not downloaded yet
2025-12-05 17:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a09aa33-c858-563f-92dc-a92f05ae1a90 with identifier: SE87574
2025-12-05 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a09aa33-c858-563f-92dc-a92f05ae1a90 with identifier: SE87574
2025-12-05 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5a09aa33-c858-563f-92dc-a92f05ae1a90 spider: auto1.es
2025-12-05 17:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5a09aa33-c858-563f-92dc-a92f05ae1a90 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:27:57Z',
 'fuel_type': 'diesel',
 'id': '5a09aa33-c858-563f-92dc-a92f05ae1a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE87574',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 130007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE87574%27 HTTP/1.1" 200 None
2025-12-05 17:05:35 [auto1.es] INFO: Saving data for SE87574: {'auction_closing_time': 1765038477.0, 'created_time': 1762880584.360961, 'last_price_update_time': 1764954335.080743}
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SE87574') HTTP/1.1" 204 0
2025-12-05 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d60084e5ef531c594400273f9d93a6df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_a62fd5a21bdcd3a85fc3274c2c8430cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_aa4bbf58d950e794386d5e9c376f74c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_81a1ad10d1f02abdea8df4f628221fda.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbff5d0>
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_83dcbd106f3dcf08558d1bf2aea23c10.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83dcbd106f3dcf08558d1bf2aea23c10.jpg saved to cache
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c0510>
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_e967a34dfc5eeca05956bd0e662fade0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_e967a34dfc5eeca05956bd0e662fade0.jpg saved to cache
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 with identifier: TY01455
2025-12-05 17:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 with scrape type 1
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_a483c4ed407fd625b227350415b6b476.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_a483c4ed407fd625b227350415b6b476.jpg not downloaded yet
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690581290>
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_cd3f4d775265b5a3eb87ad5dc2fb2827.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_cd3f4d775265b5a3eb87ad5dc2fb2827.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5cee90>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_d5800a225d3ee6eec3c38d5026a9e87c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d5800a225d3ee6eec3c38d5026a9e87c.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_bf8d2f4857772c6bc7638f1296205859.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_04b616a821fcc279735401e847178cae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_9f6b70125a140ba9845e679733342c82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_9f6b70125a140ba9845e679733342c82.jpg not downloaded yet
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_ba5051cb40e7febf362f22a1eb4e85b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ba5051cb40e7febf362f22a1eb4e85b4.jpg not downloaded yet
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_d92faa1e5212339ac9bc1921e8d32d5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d92faa1e5212339ac9bc1921e8d32d5c.jpg not downloaded yet
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_154e94fa26d86e24adbac1c47608965d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_154e94fa26d86e24adbac1c47608965d.jpg not downloaded yet
2025-12-05 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_bb320cda29ec782ac656ee10ee08325a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_8b9759cd31e95f6c1c29fb853d8c867d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_63e683fd1e5bb22f09e36b3832a17fb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_63e683fd1e5bb22f09e36b3832a17fb3.jpg not downloaded yet
2025-12-05 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS38549> (referer: https://www.auto1.com/v1/car-details-view/TS38549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_4c1009ee3f5d185ce6d54e98c56330cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_48192c52205ebde9c251d863747a3d5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_48192c52205ebde9c251d863747a3d5a.jpg not downloaded yet
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_76785c8758ee57e5048426fc980a7855.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_76785c8758ee57e5048426fc980a7855.jpg not downloaded yet
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_b5b9eccaa8f964cf751393833278fbcb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_b5b9eccaa8f964cf751393833278fbcb.jpg not downloaded yet
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_be005591b14b880516a8883373649a07.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_be005591b14b880516a8883373649a07.jpg not downloaded yet
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da2a7d0>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_e05dfd18966f2d1aa9898101b0d32aa0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_e05dfd18966f2d1aa9898101b0d32aa0.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da82050>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_a7305c1e633cc955f24e5b876a2bf8f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_a7305c1e633cc955f24e5b876a2bf8f2.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e564ad0>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_395c6e16f41dd34433910a2d399583ee.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_395c6e16f41dd34433910a2d399583ee.jpg saved to cache
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f5f721d-9ad4-555b-ac47-24f55e6e792f with identifier: GR03905
2025-12-05 17:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f5f721d-9ad4-555b-ac47-24f55e6e792f with scrape type 2
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f5f721d-9ad4-555b-ac47-24f55e6e792f with scrape type 2
2025-12-05 17:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f5f721d-9ad4-555b-ac47-24f55e6e792f, identifier: GR03905
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48c550>
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_d60084e5ef531c594400273f9d93a6df.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d60084e5ef531c594400273f9d93a6df.jpg saved to cache
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e546250>
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_a62fd5a21bdcd3a85fc3274c2c8430cd.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_a62fd5a21bdcd3a85fc3274c2c8430cd.jpg saved to cache
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e573090>
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_aa4bbf58d950e794386d5e9c376f74c8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_aa4bbf58d950e794386d5e9c376f74c8.jpg saved to cache
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668daddb90>
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_81a1ad10d1f02abdea8df4f628221fda.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_81a1ad10d1f02abdea8df4f628221fda.jpg saved to cache
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_0c77b3c7e49593352a0034da56486432.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_657379184ccb4b3146937dad80c42e1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_657379184ccb4b3146937dad80c42e1f.jpg not downloaded yet
2025-12-05 17:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f5f721d-9ad4-555b-ac47-24f55e6e792f with identifier: GR03905
2025-12-05 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f5f721d-9ad4-555b-ac47-24f55e6e792f with identifier: GR03905
2025-12-05 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8f5f721d-9ad4-555b-ac47-24f55e6e792f spider: auto1.es
2025-12-05 17:05:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8f5f721d-9ad4-555b-ac47-24f55e6e792f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:07:27Z',
 'fuel_type': 'diesel',
 'id': '8f5f721d-9ad4-555b-ac47-24f55e6e792f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR03905',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 131670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR03905%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [auto1.es] INFO: Saving data for GR03905: {'auction_closing_time': 1765037247.0, 'created_time': 1762880574.185308, 'last_price_update_time': 1764954338.447714}
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR03905') HTTP/1.1" 204 0
2025-12-05 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0435032dccd8e3724b8e1ce1a94949cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_07c4eaaedb53366b3ab81653dd249251.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_3b1c231e852a26f90418936af1a59fa0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_3b1c231e852a26f90418936af1a59fa0.jpg not downloaded yet
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_25a7d2e451ac08279cbd4ad2cc044987.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_25a7d2e451ac08279cbd4ad2cc044987.jpg not downloaded yet
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_6c0d26016d0b748070760a1d02af5aeb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6c0d26016d0b748070760a1d02af5aeb.jpg not downloaded yet
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_4fcb366647de2936521a74ed8b868172.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4fcb366647de2936521a74ed8b868172.jpg not downloaded yet
2025-12-05 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_af07da0c02c2cae7d8b6d829674e2ad7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_2af18950e7f6a52dd225dce2ece36e14.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_effd0f2be479441445026f373bf6a036.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_effd0f2be479441445026f373bf6a036.jpg not downloaded yet
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbbc810>
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_bf8d2f4857772c6bc7638f1296205859.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_bf8d2f4857772c6bc7638f1296205859.jpg saved to cache
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da55090>
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_04b616a821fcc279735401e847178cae.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_04b616a821fcc279735401e847178cae.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9978d0>
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_bb320cda29ec782ac656ee10ee08325a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_bb320cda29ec782ac656ee10ee08325a.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab6950>
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_8b9759cd31e95f6c1c29fb853d8c867d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_8b9759cd31e95f6c1c29fb853d8c867d.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e60663c2-4570-5455-a931-d682fd238c75 with identifier: TS38549
2025-12-05 17:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e60663c2-4570-5455-a931-d682fd238c75 with scrape type 2
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e60663c2-4570-5455-a931-d682fd238c75 with scrape type 2
2025-12-05 17:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e60663c2-4570-5455-a931-d682fd238c75, identifier: TS38549
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d927110>
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_4c1009ee3f5d185ce6d54e98c56330cf.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_4c1009ee3f5d185ce6d54e98c56330cf.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_cb613374dc09e4cac1f08f5cd1c2bd51.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_6342aa6d9cbc8b14773e6e35a31890e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dcf9ffb8b71fe3290737020f7622e1d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d500e8e0de2f29a08b57ae5c658adbf4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_b44184bfbe3035b3cdcac01ddb1243cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_b44184bfbe3035b3cdcac01ddb1243cb.jpg not downloaded yet
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_78506cc05b9d208b6c06950fb8417775.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_78506cc05b9d208b6c06950fb8417775.jpg not downloaded yet
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_9bf45645f89bb7e177501743601895d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_9bf45645f89bb7e177501743601895d1.jpg not downloaded yet
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_83fea7cc4b858913b1d40a727f4e7ce0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83fea7cc4b858913b1d40a727f4e7ce0.jpg not downloaded yet
2025-12-05 17:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e60663c2-4570-5455-a931-d682fd238c75 with identifier: TS38549
2025-12-05 17:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e60663c2-4570-5455-a931-d682fd238c75 with identifier: TS38549
2025-12-05 17:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e60663c2-4570-5455-a931-d682fd238c75 spider: auto1.es
2025-12-05 17:05:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e60663c2-4570-5455-a931-d682fd238c75 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:25:19Z',
 'fuel_type': 'diesel',
 'id': 'e60663c2-4570-5455-a931-d682fd238c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS38549',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 148140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS38549%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [auto1.es] INFO: Saving data for TS38549: {'auction_closing_time': 1765038319.0, 'created_time': 1762880585.468961, 'last_price_update_time': 1764954340.175636}
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS38549') HTTP/1.1" 204 0
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_af5cf306a097e8559e7e4f5a12d81be9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_af5cf306a097e8559e7e4f5a12d81be9.jpg not downloaded yet
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e77aa50>
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_0c77b3c7e49593352a0034da56486432.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_0c77b3c7e49593352a0034da56486432.jpg saved to cache
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d92faa1e5212339ac9bc1921e8d32d5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_2136574e7ab1a78e5d1175ab2e1a6f34.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_3fa44445a48fc375c09ceff562618778.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_30059e69f51351340ae77c671df092ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_30059e69f51351340ae77c671df092ac.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_75118694e4bbd2139d4fa06653281efb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_75118694e4bbd2139d4fa06653281efb.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_8f4578eca6d13a7e05f86e75ce189ee0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_8f4578eca6d13a7e05f86e75ce189ee0.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_62823856db6fc0c48f7e4b60b08c6890.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_62823856db6fc0c48f7e4b60b08c6890.jpg not downloaded yet
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_154e94fa26d86e24adbac1c47608965d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_0e435ea82c24d39f59b46dd056204765.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0e435ea82c24d39f59b46dd056204765.jpg not downloaded yet
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_9f6b70125a140ba9845e679733342c82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ba5051cb40e7febf362f22a1eb4e85b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_ca08f112801950b33dd64ccdbfb9d6f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_ca08f112801950b33dd64ccdbfb9d6f7.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_73229fa24809105229e58c81b38fe499.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_73229fa24809105229e58c81b38fe499.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_6e2012d984e841c3df1f122719d7e489.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6e2012d984e841c3df1f122719d7e489.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_49968bc4da400debe102e794bc5f33e3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_49968bc4da400debe102e794bc5f33e3.jpg not downloaded yet
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d932a90>
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_0435032dccd8e3724b8e1ce1a94949cf.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0435032dccd8e3724b8e1ce1a94949cf.jpg saved to cache
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc14750>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_07c4eaaedb53366b3ab81653dd249251.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_07c4eaaedb53366b3ab81653dd249251.jpg saved to cache
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e57d350>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_af07da0c02c2cae7d8b6d829674e2ad7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_af07da0c02c2cae7d8b6d829674e2ad7.jpg saved to cache
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dad2490>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F24%252F61240aa247cac28c0b34699f30af56cb%252Fpa%252FYR71719_2af18950e7f6a52dd225dce2ece36e14.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_2af18950e7f6a52dd225dce2ece36e14.jpg saved to cache
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e033c467-e410-5ad2-a05c-260b031feb8a
2025-12-05 17:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e033c467-e410-5ad2-a05c-260b031feb8a, skipping ID generation
2025-12-05 17:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e033c467-e410-5ad2-a05c-260b031feb8a with scrape type 1
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e033c467-e410-5ad2-a05c-260b031feb8a from tracking dictionaries
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e033c467-e410-5ad2-a05c-260b031feb8a sending to next pipeline
2025-12-05 17:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e033c467-e410-5ad2-a05c-260b031feb8a, identifier: YR71719
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d995d10>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_cb613374dc09e4cac1f08f5cd1c2bd51.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_cb613374dc09e4cac1f08f5cd1c2bd51.jpg saved to cache
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e43e550>
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_6342aa6d9cbc8b14773e6e35a31890e1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_6342aa6d9cbc8b14773e6e35a31890e1.jpg saved to cache
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da22990>
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_dcf9ffb8b71fe3290737020f7622e1d1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dcf9ffb8b71fe3290737020f7622e1d1.jpg saved to cache
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d914d10>
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_d500e8e0de2f29a08b57ae5c658adbf4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d500e8e0de2f29a08b57ae5c658adbf4.jpg saved to cache
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_55603b80f8ba47080b3df942fe65d3fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_55603b80f8ba47080b3df942fe65d3fa.jpg not downloaded yet
2025-12-05 17:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719
2025-12-05 17:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719
2025-12-05 17:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e033c467-e410-5ad2-a05c-260b031feb8a with identifier: YR71719 to the API
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_2af18950e7f6a52dd225dce2ece36e14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:52:48Z',
 'fuel_type': 'petrol',
 'id': 'e033c467-e410-5ad2-a05c-260b031feb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR71719',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 147469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_713171f80a634f497aada3ba567a3ad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_5f020de0a013fa166d308801db751902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e9f1083601669a05d4c5ac8eac9a9a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_c814128ec2171e789d4989381aa1c0e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_e4a6bbb7816d510a3ac87a998a7e8ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_9846cdef272001282c8320d76d7498b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_6ab63e4a198efc5de93d00a806f95b1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_175af7ac42eb1404924615c7b3d115b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_f6ef089435e1948894db6ffdf1521d74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_67a3a980f8cc8a29fb4779337ebd74c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0c5dcc8978b99647ed83a6de8f8dad7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d5800a225d3ee6eec3c38d5026a9e87c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_395c6e16f41dd34433910a2d399583ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_d60084e5ef531c594400273f9d93a6df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_0435032dccd8e3724b8e1ce1a94949cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e033c467-e410-5ad2-a05c-260b031feb8a/e033c467-e410-5ad2-a05c-260b031feb8a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/24/61240aa247cac28c0b34699f30af56cb/pa/YR71719_2af18950e7f6a52dd225dce2ece36e14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Tech',
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2019}
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [auto1.es] INFO: Saving data for YR71719: {'created_time': 1764954343.117885, 'last_price_update_time': 1764954343.117896, 'auction_closing_time': 1765039968.0}
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR71719') HTTP/1.1" 204 0
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_da8767882c80b22b6eb597457a326075.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_da8767882c80b22b6eb597457a326075.jpg not downloaded yet
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_180d7ba7f64e04e69554577e5bbf7e64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_180d7ba7f64e04e69554577e5bbf7e64.jpg not downloaded yet
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_89133ff57cea6d71bcfeaa72df3adc91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_89133ff57cea6d71bcfeaa72df3adc91.jpg not downloaded yet
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_dded0e82397724fa3aac7e782dcd5138.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dded0e82397724fa3aac7e782dcd5138.jpg not downloaded yet
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_63e683fd1e5bb22f09e36b3832a17fb3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_be005591b14b880516a8883373649a07.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_b5b9eccaa8f964cf751393833278fbcb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_76785c8758ee57e5048426fc980a7855.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_657379184ccb4b3146937dad80c42e1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_cf46a95bf39145fe3393267251fa9918.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_cf46a95bf39145fe3393267251fa9918.jpg not downloaded yet
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE14624> (referer: https://www.auto1.com/v1/car-details-view/UE14624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d90fb50>
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_d92faa1e5212339ac9bc1921e8d32d5c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d92faa1e5212339ac9bc1921e8d32d5c.jpg saved to cache
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fe290>
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_2136574e7ab1a78e5d1175ab2e1a6f34.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_2136574e7ab1a78e5d1175ab2e1a6f34.jpg saved to cache
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fca10>
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_3fa44445a48fc375c09ceff562618778.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_3fa44445a48fc375c09ceff562618778.jpg saved to cache
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f0e90>
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_154e94fa26d86e24adbac1c47608965d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_154e94fa26d86e24adbac1c47608965d.jpg saved to cache
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da0aa10>
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_9f6b70125a140ba9845e679733342c82.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_9f6b70125a140ba9845e679733342c82.jpg saved to cache
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e604510>
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_ba5051cb40e7febf362f22a1eb4e85b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ba5051cb40e7febf362f22a1eb4e85b4.jpg saved to cache
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6c0d26016d0b748070760a1d02af5aeb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_effd0f2be479441445026f373bf6a036.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4fcb366647de2936521a74ed8b868172.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_c4a3e0f9c99158688b23bed27ad73093.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_c4a3e0f9c99158688b23bed27ad73093.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_dcea70f17fd25310846eaa22779733c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_dcea70f17fd25310846eaa22779733c8.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_ac1f3ec8aa343ecab4b5c33c1277cf02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_ac1f3ec8aa343ecab4b5c33c1277cf02.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_f324b24f14816a13853fe19956f31ad4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_f324b24f14816a13853fe19956f31ad4.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_ed73927a4aa035ddc43afbaa7e46cf62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ed73927a4aa035ddc43afbaa7e46cf62.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_984a30a8d7a989b2f4b57cc2d6aa6d27.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_984a30a8d7a989b2f4b57cc2d6aa6d27.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_dddf263319a56e01f9a8c8935485ed66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dddf263319a56e01f9a8c8935485ed66.jpg not downloaded yet
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7ba550>
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_63e683fd1e5bb22f09e36b3832a17fb3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_63e683fd1e5bb22f09e36b3832a17fb3.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f2210>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_be005591b14b880516a8883373649a07.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_be005591b14b880516a8883373649a07.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9febd0>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_b5b9eccaa8f964cf751393833278fbcb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_b5b9eccaa8f964cf751393833278fbcb.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da22210>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_76785c8758ee57e5048426fc980a7855.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_76785c8758ee57e5048426fc980a7855.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8891d0>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_657379184ccb4b3146937dad80c42e1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_657379184ccb4b3146937dad80c42e1f.jpg saved to cache
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f96c01a0-a7ac-542d-a213-f858fea29d2a with identifier: UE14624
2025-12-05 17:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f96c01a0-a7ac-542d-a213-f858fea29d2a with scrape type 2
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f96c01a0-a7ac-542d-a213-f858fea29d2a with scrape type 2
2025-12-05 17:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f96c01a0-a7ac-542d-a213-f858fea29d2a, identifier: UE14624
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_25a7d2e451ac08279cbd4ad2cc044987.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_62823856db6fc0c48f7e4b60b08c6890.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_9bf45645f89bb7e177501743601895d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_363d8961df7446fd1c88ecb1e62d208b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_363d8961df7446fd1c88ecb1e62d208b.jpg not downloaded yet
2025-12-05 17:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f96c01a0-a7ac-542d-a213-f858fea29d2a with identifier: UE14624
2025-12-05 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f96c01a0-a7ac-542d-a213-f858fea29d2a with identifier: UE14624
2025-12-05 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f96c01a0-a7ac-542d-a213-f858fea29d2a spider: auto1.es
2025-12-05 17:05:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f96c01a0-a7ac-542d-a213-f858fea29d2a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:24:31Z',
 'fuel_type': 'diesel',
 'id': 'f96c01a0-a7ac-542d-a213-f858fea29d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE14624',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 132686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE14624%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [auto1.es] INFO: Saving data for UE14624: {'auction_closing_time': 1765038271.0, 'created_time': 1762880583.585423, 'last_price_update_time': 1764954346.527345}
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UE14624') HTTP/1.1" 204 0
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_8f4578eca6d13a7e05f86e75ce189ee0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_75118694e4bbd2139d4fa06653281efb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_4f9428be5b31a6db554397c0cc17a793.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_4f9428be5b31a6db554397c0cc17a793.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_7c0d867276e3d014c014d702b1426273.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_7c0d867276e3d014c014d702b1426273.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg not downloaded yet
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_78506cc05b9d208b6c06950fb8417775.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83fea7cc4b858913b1d40a727f4e7ce0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_55603b80f8ba47080b3df942fe65d3fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_626bff9d35549cb7ae771dcc6bdc3243.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_626bff9d35549cb7ae771dcc6bdc3243.jpg not downloaded yet
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d996090>
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_6c0d26016d0b748070760a1d02af5aeb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6c0d26016d0b748070760a1d02af5aeb.jpg saved to cache
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97ea50>
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_effd0f2be479441445026f373bf6a036.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_effd0f2be479441445026f373bf6a036.jpg saved to cache
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8a0e90>
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_4fcb366647de2936521a74ed8b868172.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4fcb366647de2936521a74ed8b868172.jpg saved to cache
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6e2012d984e841c3df1f122719d7e489.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_73229fa24809105229e58c81b38fe499.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_7e300d3f0a3051ea21222f8af03bf6db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_7e300d3f0a3051ea21222f8af03bf6db.jpg not downloaded yet
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc26c90>
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_25a7d2e451ac08279cbd4ad2cc044987.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_25a7d2e451ac08279cbd4ad2cc044987.jpg saved to cache
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fc390>
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_62823856db6fc0c48f7e4b60b08c6890.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_62823856db6fc0c48f7e4b60b08c6890.jpg saved to cache
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da17150>
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_9bf45645f89bb7e177501743601895d1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_9bf45645f89bb7e177501743601895d1.jpg saved to cache
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_49968bc4da400debe102e794bc5f33e3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a7e90>
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_8f4578eca6d13a7e05f86e75ce189ee0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_8f4578eca6d13a7e05f86e75ce189ee0.jpg saved to cache
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cec90>
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_75118694e4bbd2139d4fa06653281efb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_75118694e4bbd2139d4fa06653281efb.jpg saved to cache
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e755450>
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_78506cc05b9d208b6c06950fb8417775.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_78506cc05b9d208b6c06950fb8417775.jpg saved to cache
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e745550>
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_83fea7cc4b858913b1d40a727f4e7ce0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83fea7cc4b858913b1d40a727f4e7ce0.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6dc710>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_55603b80f8ba47080b3df942fe65d3fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_55603b80f8ba47080b3df942fe65d3fa.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_da8767882c80b22b6eb597457a326075.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_ca08f112801950b33dd64ccdbfb9d6f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_89133ff57cea6d71bcfeaa72df3adc91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_0aedc76f1d2a41516e819108553088c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0aedc76f1d2a41516e819108553088c7.jpg not downloaded yet
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_180d7ba7f64e04e69554577e5bbf7e64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dded0e82397724fa3aac7e782dcd5138.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_f324b24f14816a13853fe19956f31ad4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da34d50>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_6e2012d984e841c3df1f122719d7e489.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6e2012d984e841c3df1f122719d7e489.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d96f390>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_73229fa24809105229e58c81b38fe499.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_73229fa24809105229e58c81b38fe499.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_ac1f3ec8aa343ecab4b5c33c1277cf02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_dcea70f17fd25310846eaa22779733c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_bb3fc05c3a666b05e00ea4fc16861960.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_bb3fc05c3a666b05e00ea4fc16861960.jpg not downloaded yet
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e607590>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_49968bc4da400debe102e794bc5f33e3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_49968bc4da400debe102e794bc5f33e3.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_984a30a8d7a989b2f4b57cc2d6aa6d27.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dddf263319a56e01f9a8c8935485ed66.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_363d8961df7446fd1c88ecb1e62d208b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_732fe53aef739f1733977191bed0c1cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_732fe53aef739f1733977191bed0c1cd.jpg not downloaded yet
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9e6910>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_da8767882c80b22b6eb597457a326075.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_da8767882c80b22b6eb597457a326075.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e68b850>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_ca08f112801950b33dd64ccdbfb9d6f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_ca08f112801950b33dd64ccdbfb9d6f7.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc1c8d0>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_89133ff57cea6d71bcfeaa72df3adc91.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_89133ff57cea6d71bcfeaa72df3adc91.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ccd90>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_180d7ba7f64e04e69554577e5bbf7e64.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_180d7ba7f64e04e69554577e5bbf7e64.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da99c90>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_dded0e82397724fa3aac7e782dcd5138.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dded0e82397724fa3aac7e782dcd5138.jpg saved to cache
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d96f6d0>
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_f324b24f14816a13853fe19956f31ad4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_f324b24f14816a13853fe19956f31ad4.jpg saved to cache
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_c4a3e0f9c99158688b23bed27ad73093.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ed73927a4aa035ddc43afbaa7e46cf62.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_7c0d867276e3d014c014d702b1426273.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg not downloaded yet
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_4f9428be5b31a6db554397c0cc17a793.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_626bff9d35549cb7ae771dcc6bdc3243.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e60f750>
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_ac1f3ec8aa343ecab4b5c33c1277cf02.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_ac1f3ec8aa343ecab4b5c33c1277cf02.jpg saved to cache
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a03d0>
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_dcea70f17fd25310846eaa22779733c8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_dcea70f17fd25310846eaa22779733c8.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a35d0>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_984a30a8d7a989b2f4b57cc2d6aa6d27.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_984a30a8d7a989b2f4b57cc2d6aa6d27.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97db90>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_dddf263319a56e01f9a8c8935485ed66.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dddf263319a56e01f9a8c8935485ed66.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a00d0>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_363d8961df7446fd1c88ecb1e62d208b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_363d8961df7446fd1c88ecb1e62d208b.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_7e300d3f0a3051ea21222f8af03bf6db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_30059e69f51351340ae77c671df092ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_cf46a95bf39145fe3393267251fa9918.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0e435ea82c24d39f59b46dd056204765.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_af5cf306a097e8559e7e4f5a12d81be9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66906d7110>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_c4a3e0f9c99158688b23bed27ad73093.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_c4a3e0f9c99158688b23bed27ad73093.jpg saved to cache
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c2490>
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_ed73927a4aa035ddc43afbaa7e46cf62.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ed73927a4aa035ddc43afbaa7e46cf62.jpg saved to cache
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e587450>
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fd3%252F7dd35ac6b6d2db2330e0dae712a966f4%252Fpa%252FGX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg saved to cache
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 467fd62d-375c-52f5-ad66-41b9bb894099
2025-12-05 17:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 467fd62d-375c-52f5-ad66-41b9bb894099, skipping ID generation
2025-12-05 17:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 467fd62d-375c-52f5-ad66-41b9bb894099 with scrape type 1
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 467fd62d-375c-52f5-ad66-41b9bb894099 from tracking dictionaries
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 467fd62d-375c-52f5-ad66-41b9bb894099 sending to next pipeline
2025-12-05 17:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 467fd62d-375c-52f5-ad66-41b9bb894099, identifier: GX28427
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a18d0>
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff3%252Ff2f3d62ac3c27f5e215c82c3623585eb%252Fpa%252FEX26806_7c0d867276e3d014c014d702b1426273.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_7c0d867276e3d014c014d702b1426273.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 09820add-9e4e-5c08-8c8f-029cde42db59
2025-12-05 17:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09820add-9e4e-5c08-8c8f-029cde42db59, skipping ID generation
2025-12-05 17:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09820add-9e4e-5c08-8c8f-029cde42db59 with scrape type 1
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 09820add-9e4e-5c08-8c8f-029cde42db59 from tracking dictionaries
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09820add-9e4e-5c08-8c8f-029cde42db59 sending to next pipeline
2025-12-05 17:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09820add-9e4e-5c08-8c8f-029cde42db59, identifier: EX26806
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e586290>
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_4f9428be5b31a6db554397c0cc17a793.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_4f9428be5b31a6db554397c0cc17a793.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8afe10>
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_626bff9d35549cb7ae771dcc6bdc3243.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_626bff9d35549cb7ae771dcc6bdc3243.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 467fd62d-375c-52f5-ad66-41b9bb894099 with identifier: GX28427
2025-12-05 17:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 467fd62d-375c-52f5-ad66-41b9bb894099 with identifier: GX28427
2025-12-05 17:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 467fd62d-375c-52f5-ad66-41b9bb894099 with identifier: GX28427 to the API
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:39:37Z',
 'fuel_type': 'petrol',
 'id': '467fd62d-375c-52f5-ad66-41b9bb894099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX28427',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 129855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83dcbd106f3dcf08558d1bf2aea23c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_aa4bbf58d950e794386d5e9c376f74c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_81a1ad10d1f02abdea8df4f628221fda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_8b9759cd31e95f6c1c29fb853d8c867d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dcf9ffb8b71fe3290737020f7622e1d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_3fa44445a48fc375c09ceff562618778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_154e94fa26d86e24adbac1c47608965d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_be005591b14b880516a8883373649a07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4fcb366647de2936521a74ed8b868172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_83fea7cc4b858913b1d40a727f4e7ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_62823856db6fc0c48f7e4b60b08c6890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_49968bc4da400debe102e794bc5f33e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dded0e82397724fa3aac7e782dcd5138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_ac1f3ec8aa343ecab4b5c33c1277cf02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_dddf263319a56e01f9a8c8935485ed66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_467fd62d-375c-52f5-ad66-41b9bb894099/467fd62d-375c-52f5-ad66-41b9bb894099_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/d3/7dd35ac6b6d2db2330e0dae712a966f4/pa/GX28427_4c612de8f8f28d7b26b6b5b59bd92b21.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru XV 2.0 Mild-Hybrid Sport Plus',
 'transmission': 'automatic',
 'trim': 'Sport Plus',
 'year': 2022}
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX28427%27 HTTP/1.1" 200 None
2025-12-05 17:05:55 [auto1.es] INFO: Saving data for GX28427: {'created_time': 1764954355.125416, 'last_price_update_time': 1764954355.125425, 'auction_closing_time': 1765039177.0}
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GX28427') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09820add-9e4e-5c08-8c8f-029cde42db59 with identifier: EX26806
2025-12-05 17:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09820add-9e4e-5c08-8c8f-029cde42db59 with identifier: EX26806
2025-12-05 17:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164997 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164997
2025-12-05 17:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 09820add-9e4e-5c08-8c8f-029cde42db59 spider: auto1.es
2025-12-05 17:05:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 09820add-9e4e-5c08-8c8f-029cde42db59 due to rule: high_mileage_for_country.json, error: 164997 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164997
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:33:03Z',
 'fuel_type': 'diesel',
 'id': '09820add-9e4e-5c08-8c8f-029cde42db59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX26806',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 164997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_e967a34dfc5eeca05956bd0e662fade0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_a62fd5a21bdcd3a85fc3274c2c8430cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_04b616a821fcc279735401e847178cae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_07c4eaaedb53366b3ab81653dd249251.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d500e8e0de2f29a08b57ae5c658adbf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_2136574e7ab1a78e5d1175ab2e1a6f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_d92faa1e5212339ac9bc1921e8d32d5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_b5b9eccaa8f964cf751393833278fbcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6c0d26016d0b748070760a1d02af5aeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_9bf45645f89bb7e177501743601895d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_8f4578eca6d13a7e05f86e75ce189ee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_6e2012d984e841c3df1f122719d7e489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_89133ff57cea6d71bcfeaa72df3adc91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_dcea70f17fd25310846eaa22779733c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_984a30a8d7a989b2f4b57cc2d6aa6d27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09820add-9e4e-5c08-8c8f-029cde42db59/09820add-9e4e-5c08-8c8f-029cde42db59_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f3/f2f3d62ac3c27f5e215c82c3623585eb/pa/EX26806_7c0d867276e3d014c014d702b1426273.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Dawn Of Justice',
 'transmission': 'manual',
 'trim': 'Dawn Of Justice',
 'year': 2016}
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX26806%27 HTTP/1.1" 200 None
2025-12-05 17:05:55 [auto1.es] INFO: Saving data for EX26806: {'created_time': 1764954355.353007, 'last_price_update_time': 1764954355.353018, 'auction_closing_time': 1765038783.0}
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EX26806') HTTP/1.1" 204 0
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_b44184bfbe3035b3cdcac01ddb1243cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_bb3fc05c3a666b05e00ea4fc16861960.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0aedc76f1d2a41516e819108553088c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_3b1c231e852a26f90418936af1a59fa0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_48192c52205ebde9c251d863747a3d5a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_732fe53aef739f1733977191bed0c1cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e449190>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_7e300d3f0a3051ea21222f8af03bf6db.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_7e300d3f0a3051ea21222f8af03bf6db.jpg saved to cache
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e556d50>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_30059e69f51351340ae77c671df092ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_30059e69f51351340ae77c671df092ac.jpg saved to cache
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e556c10>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_cf46a95bf39145fe3393267251fa9918.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_cf46a95bf39145fe3393267251fa9918.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8a0150>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_0e435ea82c24d39f59b46dd056204765.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0e435ea82c24d39f59b46dd056204765.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e3090>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_af5cf306a097e8559e7e4f5a12d81be9.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_af5cf306a097e8559e7e4f5a12d81be9.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_a483c4ed407fd625b227350415b6b476.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_f14888787fe55788a378c35b193e5ede.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_5de11d1e76f9d47e3953e9448a177e01.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_293b3106bed2b3f3b41e8993b5c29fb8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da09e50>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_b44184bfbe3035b3cdcac01ddb1243cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_b44184bfbe3035b3cdcac01ddb1243cb.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71ec50>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_bb3fc05c3a666b05e00ea4fc16861960.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_bb3fc05c3a666b05e00ea4fc16861960.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc1f390>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_0aedc76f1d2a41516e819108553088c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0aedc76f1d2a41516e819108553088c7.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e449150>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_3b1c231e852a26f90418936af1a59fa0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_3b1c231e852a26f90418936af1a59fa0.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dafbad0>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_48192c52205ebde9c251d863747a3d5a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_48192c52205ebde9c251d863747a3d5a.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e756b90>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_732fe53aef739f1733977191bed0c1cd.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_732fe53aef739f1733977191bed0c1cd.jpg saved to cache
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_3b87ec1c9862964167e1b309f9af09b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_f06a2939af062fe8ef148acd52d1ef1a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_009f824788b61a2ac3c54c2383864e88.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_6deedbb32319dd2ca25743c1161f05f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_eb62cb3301545a6a6a2bfe19854d677a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_afac159579296fb84214e3ad367334db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_c8def60a2f81ccdaedec1b1955d672c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_48bc008ee87f40e114152bd0dc67af96.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fd550>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F29%252F572967f7bbfd7b0cd1d277f83a1e0c25%252Fpa%252FRT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg saved to cache
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd
2025-12-05 17:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd, skipping ID generation
2025-12-05 17:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd with scrape type 1
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd from tracking dictionaries
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd sending to next pipeline
2025-12-05 17:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd, identifier: RT52527
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8fbc50>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_a483c4ed407fd625b227350415b6b476.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_a483c4ed407fd625b227350415b6b476.jpg saved to cache
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4484d0>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_f14888787fe55788a378c35b193e5ede.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_f14888787fe55788a378c35b193e5ede.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5bcf90>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa7%252F93a7e6bae467c577055705e1d96303be%252Fpa%252FCE36300_5de11d1e76f9d47e3953e9448a177e01.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_5de11d1e76f9d47e3953e9448a177e01.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708
2025-12-05 17:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708, skipping ID generation
2025-12-05 17:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 with scrape type 1
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 from tracking dictionaries
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 sending to next pipeline
2025-12-05 17:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708, identifier: CE36300
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e68aa90>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fba%252F18ba1779b30c47b92a56e44eb98cb636%252Fpa%252FTY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99
2025-12-05 17:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 783faf3f-47f7-527d-8c32-6cb7ff9cfb99, skipping ID generation
2025-12-05 17:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 with scrape type 1
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 from tracking dictionaries
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 sending to next pipeline
2025-12-05 17:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 783faf3f-47f7-527d-8c32-6cb7ff9cfb99, identifier: TY01455
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e575d10>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_293b3106bed2b3f3b41e8993b5c29fb8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_293b3106bed2b3f3b41e8993b5c29fb8.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd with identifier: RT52527
2025-12-05 17:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd with identifier: RT52527
2025-12-05 17:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd with identifier: RT52527 to the API
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-06T16:00:24Z',
 'fuel_type': 'hybrid',
 'id': '73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT52527',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 61188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_cd3f4d775265b5a3eb87ad5dc2fb2827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_af07da0c02c2cae7d8b6d829674e2ad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_bb320cda29ec782ac656ee10ee08325a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_0c77b3c7e49593352a0034da56486432.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_6342aa6d9cbc8b14773e6e35a31890e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_3984aa0ff6609ca2e6c653e9ba6aaee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ba5051cb40e7febf362f22a1eb4e85b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_76785c8758ee57e5048426fc980a7855.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_25a7d2e451ac08279cbd4ad2cc044987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_78506cc05b9d208b6c06950fb8417775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_75118694e4bbd2139d4fa06653281efb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_73229fa24809105229e58c81b38fe499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_180d7ba7f64e04e69554577e5bbf7e64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_c4a3e0f9c99158688b23bed27ad73093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_ed73927a4aa035ddc43afbaa7e46cf62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd/73c81fa1-8a6e-5aaf-b19c-9d4c3fdff6cd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/29/572967f7bbfd7b0cd1d277f83a1e0c25/pa/RT52527_4f9428be5b31a6db554397c0cc17a793.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT52527%27 HTTP/1.1" 200 None
2025-12-05 17:06:00 [auto1.es] INFO: Saving data for RT52527: {'created_time': 1764954360.347957, 'last_price_update_time': 1764954360.347967, 'auction_closing_time': 1765036824.0}
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT52527') HTTP/1.1" 204 0
2025-12-05 17:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 with identifier: CE36300
2025-12-05 17:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 with identifier: CE36300
2025-12-05 17:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2025-12-05 17:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 spider: auto1.es
2025-12-05 17:06:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1a8b93d7-1ea3-5c07-ac92-809d8c4c8708 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:03:26Z',
 'fuel_type': 'diesel',
 'id': '1a8b93d7-1ea3-5c07-ac92-809d8c4c8708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE36300',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 161951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65748,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_a7305c1e633cc955f24e5b876a2bf8f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65748,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_5de11d1e76f9d47e3953e9448a177e01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41299,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_bf8d2f4857772c6bc7638f1296205859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41299,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_4c1009ee3f5d185ce6d54e98c56330cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41299,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_cb613374dc09e4cac1f08f5cd1c2bd51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41299,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_f14888787fe55788a378c35b193e5ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49609,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_9f6b70125a140ba9845e679733342c82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49609,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_48192c52205ebde9c251d863747a3d5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63958,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_3b1c231e852a26f90418936af1a59fa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54724,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_b44184bfbe3035b3cdcac01ddb1243cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55549,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_30059e69f51351340ae77c671df092ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38669,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_ca08f112801950b33dd64ccdbfb9d6f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8b93d7-1ea3-5c07-ac92-809d8c4c8708/1a8b93d7-1ea3-5c07-ac92-809d8c4c8708_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38669,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img93/a7/93a7e6bae467c577055705e1d96303be/pa/CE36300_da8767882c80b22b6eb597457a326075.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2022}
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE36300%27 HTTP/1.1" 200 None
2025-12-05 17:06:00 [auto1.es] INFO: Saving data for CE36300: {'created_time': 1764954360.567301, 'last_price_update_time': 1764954360.567311, 'auction_closing_time': 1765037006.0}
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE36300') HTTP/1.1" 204 0
2025-12-05 17:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 with identifier: TY01455
2025-12-05 17:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 with identifier: TY01455
2025-12-05 17:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 783faf3f-47f7-527d-8c32-6cb7ff9cfb99 with identifier: TY01455 to the API
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2025-12-06T16:06:13Z',
 'fuel_type': 'petrol',
 'id': '783faf3f-47f7-527d-8c32-6cb7ff9cfb99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY01455',
 'listing': 'auction',
 'location': 'ES, La Linea, Cadiz',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 24598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_a483c4ed407fd625b227350415b6b476.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_63e683fd1e5bb22f09e36b3832a17fb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_657379184ccb4b3146937dad80c42e1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_effd0f2be479441445026f373bf6a036.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_af5cf306a097e8559e7e4f5a12d81be9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0e435ea82c24d39f59b46dd056204765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_55603b80f8ba47080b3df942fe65d3fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_cf46a95bf39145fe3393267251fa9918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_f324b24f14816a13853fe19956f31ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_363d8961df7446fd1c88ecb1e62d208b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_626bff9d35549cb7ae771dcc6bdc3243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_7e300d3f0a3051ea21222f8af03bf6db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_0aedc76f1d2a41516e819108553088c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_bb3fc05c3a666b05e00ea4fc16861960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_732fe53aef739f1733977191bed0c1cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783faf3f-47f7-527d-8c32-6cb7ff9cfb99/783faf3f-47f7-527d-8c32-6cb7ff9cfb99_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18ba1779b30c47b92a56e44eb98cb636/pa/TY01455_19b0e91a80b3e3daaed5ed8c3657501a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2022}
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY01455%27 HTTP/1.1" 200 None
2025-12-05 17:06:00 [auto1.es] INFO: Saving data for TY01455: {'created_time': 1764954360.947371, 'last_price_update_time': 1764954360.94738, 'auction_closing_time': 1765037173.0}
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TY01455') HTTP/1.1" 204 0
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_c99b13323c6fe91e85fa545adeef1f23.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_d7e83bb309eb32bfcca80635a8328489.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_26d0d7261df937f2a2fbf29f778e8345.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU60335> (referer: https://www.auto1.com/v1/car-details-view/GU60335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7b8b90>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_3b87ec1c9862964167e1b309f9af09b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_3b87ec1c9862964167e1b309f9af09b3.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8fa090>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_f06a2939af062fe8ef148acd52d1ef1a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_f06a2939af062fe8ef148acd52d1ef1a.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7b250>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_009f824788b61a2ac3c54c2383864e88.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_009f824788b61a2ac3c54c2383864e88.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66905ecd90>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_6deedbb32319dd2ca25743c1161f05f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_6deedbb32319dd2ca25743c1161f05f2.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a5290>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_eb62cb3301545a6a6a2bfe19854d677a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_eb62cb3301545a6a6a2bfe19854d677a.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da40090>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_afac159579296fb84214e3ad367334db.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_afac159579296fb84214e3ad367334db.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da43450>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_c8def60a2f81ccdaedec1b1955d672c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_c8def60a2f81ccdaedec1b1955d672c4.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc204d0>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_48bc008ee87f40e114152bd0dc67af96.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_48bc008ee87f40e114152bd0dc67af96.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC18749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK00839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6d4390>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F44%252Fb94408ed65b14a1b03a765877fef94e6%252Fpa%252FMY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a476f0e2-54a0-5b2e-989e-2d96b48e475a
2025-12-05 17:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a476f0e2-54a0-5b2e-989e-2d96b48e475a, skipping ID generation
2025-12-05 17:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a476f0e2-54a0-5b2e-989e-2d96b48e475a with scrape type 1
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a476f0e2-54a0-5b2e-989e-2d96b48e475a from tracking dictionaries
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a476f0e2-54a0-5b2e-989e-2d96b48e475a sending to next pipeline
2025-12-05 17:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a476f0e2-54a0-5b2e-989e-2d96b48e475a, identifier: MY29147
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66914e0050>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_c99b13323c6fe91e85fa545adeef1f23.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_c99b13323c6fe91e85fa545adeef1f23.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48c810>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_d7e83bb309eb32bfcca80635a8328489.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_d7e83bb309eb32bfcca80635a8328489.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d7510>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff9%252Ffbf9e61b1d429faf6d5b031c3a413389%252Fpa%252FFS96341_26d0d7261df937f2a2fbf29f778e8345.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_26d0d7261df937f2a2fbf29f778e8345.jpg saved to cache
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c
2025-12-05 17:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c, skipping ID generation
2025-12-05 17:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c with scrape type 1
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c from tracking dictionaries
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c sending to next pipeline
2025-12-05 17:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c, identifier: FS96341
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe9e10>
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F90%252Fb7909b4eeebba84608df5540877803b0%252Fpa%252FTJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg saved to cache
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72822491-0771-50fe-81b5-65402a31fbbb
2025-12-05 17:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72822491-0771-50fe-81b5-65402a31fbbb, skipping ID generation
2025-12-05 17:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72822491-0771-50fe-81b5-65402a31fbbb with scrape type 1
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 72822491-0771-50fe-81b5-65402a31fbbb from tracking dictionaries
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72822491-0771-50fe-81b5-65402a31fbbb sending to next pipeline
2025-12-05 17:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72822491-0771-50fe-81b5-65402a31fbbb, identifier: TJ60930
2025-12-05 17:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f727b1bf-447d-5dc5-8fbb-ee4eeb088962 with identifier: GU60335
2025-12-05 17:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f727b1bf-447d-5dc5-8fbb-ee4eeb088962 with scrape type 2
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f727b1bf-447d-5dc5-8fbb-ee4eeb088962 with scrape type 2
2025-12-05 17:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f727b1bf-447d-5dc5-8fbb-ee4eeb088962, identifier: GU60335
2025-12-05 17:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147
2025-12-05 17:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147
2025-12-05 17:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147 to the API
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:43:11Z',
 'fuel_type': 'petrol',
 'id': 'a476f0e2-54a0-5b2e-989e-2d96b48e475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY29147',
 'listing': 'auction',
 'location': 'ES, Sagunt, València',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 65225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_0ee63ab17a121b5dbaa67aa30beb0cac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_48bc008ee87f40e114152bd0dc67af96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_f06a2939af062fe8ef148acd52d1ef1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_009f824788b61a2ac3c54c2383864e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_c8def60a2f81ccdaedec1b1955d672c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_293b3106bed2b3f3b41e8993b5c29fb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_dede6288b2e413d755e8b57072d86d02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_23632a8691014a96a3559f56f37c5f44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_97371ae9f09ddf97e6c1e58ae3f2db2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e6b5748e4a4ab345f9fdc90d1deff5fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d30370326313146de389ec82ae37140b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_d00981b5c6838b2ca16d5afe4d7d601a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_e54df78c335b0d293ebdeaf405d5ac58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_ac730153b74133767b8830ae1e214577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a476f0e2-54a0-5b2e-989e-2d96b48e475a/a476f0e2-54a0-5b2e-989e-2d96b48e475a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/44/b94408ed65b14a1b03a765877fef94e6/pa/MY29147_bbb4a0a6a8077ff43eb9d22e63c72698.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2017}
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY29147%27 HTTP/1.1" 200 None
2025-12-05 17:06:04 [auto1.es] INFO: Saving data for MY29147: {'created_time': 1764954364.95346, 'last_price_update_time': 1764954364.95347, 'auction_closing_time': 1765039391.0}
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY29147') HTTP/1.1" 204 0
2025-12-05 17:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c with identifier: FS96341
2025-12-05 17:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c with identifier: FS96341
2025-12-05 17:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c with identifier: FS96341 to the API
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_26d0d7261df937f2a2fbf29f778e8345.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:29:42Z',
 'fuel_type': 'diesel',
 'id': 'ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS96341',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 130545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_26d0d7261df937f2a2fbf29f778e8345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_c99b13323c6fe91e85fa545adeef1f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_dc3771e9c8f7eca13def8f78e22c08af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_d6cbf94ab1b7360ff8b5f8bf00c72986.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_217903c4b19474b57ac4c9d82509dacb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_a54bfded8ee7d0595986707f6f257767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_5532f2b31824076ca633a3fe216e937f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_1ad4f6d5f3c7490bf609652549b472ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_059b3cad654525fa7ee4d9210f6252eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_ef6ae57ecfcf9a570a5666ecd8d80319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f87e5a068d97903f1d6a929582fe86ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_25d1bc73a6ae598e9f2f638e75623290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_96e9f314c0e40e367038ffa7b4e5e32c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_f3c400d9cc8a43f0b0ec0454989f5682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_596dff9f8c770ff584263f99f772b72c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c/ead3dbcf-fffc-55b8-94e0-7df41c2e8b6c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f9/fbf9e61b1d429faf6d5b031c3a413389/pa/FS96341_095bd0f8a0db97d0865c55d6003f1f04.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2016}
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS96341%27 HTTP/1.1" 200 None
2025-12-05 17:06:05 [auto1.es] INFO: Saving data for FS96341: {'created_time': 1764954365.387095, 'last_price_update_time': 1764954365.387104, 'auction_closing_time': 1765038582.0}
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FS96341') HTTP/1.1" 204 0
2025-12-05 17:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72822491-0771-50fe-81b5-65402a31fbbb with identifier: TJ60930
2025-12-05 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72822491-0771-50fe-81b5-65402a31fbbb with identifier: TJ60930
2025-12-05 17:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72822491-0771-50fe-81b5-65402a31fbbb with identifier: TJ60930 to the API
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:31:59Z',
 'fuel_type': 'diesel',
 'id': '72822491-0771-50fe-81b5-65402a31fbbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ60930',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 49030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_d7e83bb309eb32bfcca80635a8328489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_48fdff642bdbe3b5124623ed993dceaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_3b87ec1c9862964167e1b309f9af09b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_afac159579296fb84214e3ad367334db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_6deedbb32319dd2ca25743c1161f05f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_eb62cb3301545a6a6a2bfe19854d677a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_e05dfd18966f2d1aa9898101b0d32aa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9936561f3032d8acb194a1483d164aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_db598746e6bcfff397129da371a0549b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_4a0962e24a325d8ccb18728c3c698eab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_bd71ecc20343128ec408fec7f8cfe30d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_15640650f8baa3869aa12c3a53459bb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_ca8fd0b71844cd9ee4d4fa2305851531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_9a87c5d83810ec8bbdb1ed88e07f6bf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_68ce0067985e91b6d4a35a5fc6f7bc42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72822491-0771-50fe-81b5-65402a31fbbb/72822491-0771-50fe-81b5-65402a31fbbb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/90/b7909b4eeebba84608df5540877803b0/pa/TJ60930_909de5b2c82402a018988e330feb514b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ60930%27 HTTP/1.1" 200 None
2025-12-05 17:06:05 [auto1.es] INFO: Saving data for TJ60930: {'created_time': 1764954365.745256, 'last_price_update_time': 1764954365.745269, 'auction_closing_time': 1765038719.0}
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ60930') HTTP/1.1" 204 0
2025-12-05 17:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f727b1bf-447d-5dc5-8fbb-ee4eeb088962 with identifier: GU60335
2025-12-05 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f727b1bf-447d-5dc5-8fbb-ee4eeb088962 with identifier: GU60335
2025-12-05 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154193 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154193
2025-12-05 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f727b1bf-447d-5dc5-8fbb-ee4eeb088962 spider: auto1.es
2025-12-05 17:06:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f727b1bf-447d-5dc5-8fbb-ee4eeb088962 due to rule: high_mileage_for_country.json, error: 154193 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154193
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:57:23Z',
 'fuel_type': 'diesel',
 'id': 'f727b1bf-447d-5dc5-8fbb-ee4eeb088962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU60335',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 154193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU60335%27 HTTP/1.1" 200 None
2025-12-05 17:06:06 [auto1.es] INFO: Saving data for GU60335: {'auction_closing_time': 1765040243.0, 'created_time': 1759924644.615377, 'last_price_update_time': 1764954366.002032}
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU60335') HTTP/1.1" 204 0
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA66568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT67335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF64516/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB62994/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK27651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS95415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA94679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP28290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN26458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU50952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF50859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN60330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS24104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ69467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX91885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR85149/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB64623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC20830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [scrapy.extensions.logstats] INFO: Crawled 589 pages (at 71 pages/min), scraped 178 items (at 16 items/min)
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY38096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN30281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK27651> (referer: https://www.auto1.com/v1/car-details-view/PK27651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB62994> (referer: https://www.auto1.com/v1/car-details-view/VB62994/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS95415> (referer: https://www.auto1.com/v1/car-details-view/PS95415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with identifier: PK27651
2025-12-05 17:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with scrape type 2
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with scrape type 2
2025-12-05 17:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb, identifier: PK27651
2025-12-05 17:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with identifier: PK27651
2025-12-05 17:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with identifier: PK27651
2025-12-05 17:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2025-12-05 17:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb spider: auto1.es
2025-12-05 17:06:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:42:25Z',
 'fuel_type': 'diesel',
 'id': '38a8e7c6-ece6-54ca-966f-2b478ffa87fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK27651',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 118972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2022}
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK27651%27 HTTP/1.1" 200 None
2025-12-05 17:06:09 [auto1.es] INFO: Saving data for PK27651: {'auction_closing_time': 1765039345.0, 'created_time': 1763744677.968785, 'last_price_update_time': 1764954369.010612}
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK27651') HTTP/1.1" 204 0
2025-12-05 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF64516> (referer: https://www.auto1.com/v1/car-details-view/GF64516/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT67335> (referer: https://www.auto1.com/v1/car-details-view/JT67335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 with identifier: VB62994
2025-12-05 17:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 with scrape type 2
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 with scrape type 2
2025-12-05 17:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 950270f6-3c1a-5936-8a7d-1dbd15e8aef1, identifier: VB62994
2025-12-05 17:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6a0b1e7-8006-5aad-ac10-8bd615e1926e with identifier: PS95415
2025-12-05 17:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a0b1e7-8006-5aad-ac10-8bd615e1926e with scrape type 2
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6a0b1e7-8006-5aad-ac10-8bd615e1926e with scrape type 2
2025-12-05 17:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6a0b1e7-8006-5aad-ac10-8bd615e1926e, identifier: PS95415
2025-12-05 17:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 with identifier: VB62994
2025-12-05 17:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 with identifier: VB62994
2025-12-05 17:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2025-12-05 17:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 spider: auto1.es
2025-12-05 17:06:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 950270f6-3c1a-5936-8a7d-1dbd15e8aef1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:23:02Z',
 'fuel_type': 'electro',
 'id': '950270f6-3c1a-5936-8a7d-1dbd15e8aef1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB62994',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 26386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB62994%27 HTTP/1.1" 200 None
2025-12-05 17:06:09 [auto1.es] INFO: Saving data for VB62994: {'auction_closing_time': 1765038182.0, 'created_time': 1763034767.454965, 'last_price_update_time': 1764954369.447726}
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB62994') HTTP/1.1" 204 0
2025-12-05 17:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6a0b1e7-8006-5aad-ac10-8bd615e1926e with identifier: PS95415
2025-12-05 17:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6a0b1e7-8006-5aad-ac10-8bd615e1926e with identifier: PS95415
2025-12-05 17:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6a0b1e7-8006-5aad-ac10-8bd615e1926e with identifier: PS95415 to the API
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS95415>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:12:51Z',
 'fuel_type': 'petrol',
 'id': 'b6a0b1e7-8006-5aad-ac10-8bd615e1926e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS95415',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 88331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS95415%27 HTTP/1.1" 200 None
2025-12-05 17:06:09 [auto1.es] INFO: Saving data for PS95415: {'auction_closing_time': 1765037571.0, 'created_time': 1761670836.677756, 'last_price_update_time': 1764954369.785784}
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS95415') HTTP/1.1" 204 0
2025-12-05 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA66568> (referer: https://www.auto1.com/v1/car-details-view/CA66568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 with identifier: GF64516
2025-12-05 17:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 with scrape type 2
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 with scrape type 2
2025-12-05 17:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6, identifier: GF64516
2025-12-05 17:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 with identifier: JT67335
2025-12-05 17:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 with scrape type 1
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_52763d2e429cba6dad1ae696261796fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_52763d2e429cba6dad1ae696261796fe.jpg not downloaded yet
2025-12-05 17:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 with identifier: GF64516
2025-12-05 17:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 with identifier: GF64516
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188158 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188158
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 spider: auto1.es
2025-12-05 17:06:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6 due to rule: high_mileage_for_country.json, error: 188158 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188158
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:58:07Z',
 'fuel_type': 'diesel',
 'id': '5a2c2fe0-a657-5c4b-94b1-a895ee9df7c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF64516',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 188158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF64516%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [auto1.es] INFO: Saving data for GF64516: {'auction_closing_time': 1765040287.0, 'created_time': 1762880523.167298, 'last_price_update_time': 1764954370.127039}
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF64516') HTTP/1.1" 204 0
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_d3af5fb503faf5f578c20a55b4c14375.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_d3af5fb503faf5f578c20a55b4c14375.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_c9f10c496ea9da53e5d1f88152003f0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c9f10c496ea9da53e5d1f88152003f0f.jpg not downloaded yet
2025-12-05 17:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c66706bc-507e-5dfa-b78e-cd56a4201012 with identifier: CA66568
2025-12-05 17:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c66706bc-507e-5dfa-b78e-cd56a4201012 with scrape type 2
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c66706bc-507e-5dfa-b78e-cd56a4201012 with scrape type 2
2025-12-05 17:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c66706bc-507e-5dfa-b78e-cd56a4201012, identifier: CA66568
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg not downloaded yet
2025-12-05 17:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c66706bc-507e-5dfa-b78e-cd56a4201012 with identifier: CA66568
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c66706bc-507e-5dfa-b78e-cd56a4201012 with identifier: CA66568
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189589 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189589
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c66706bc-507e-5dfa-b78e-cd56a4201012 spider: auto1.es
2025-12-05 17:06:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c66706bc-507e-5dfa-b78e-cd56a4201012 due to rule: high_mileage_for_country.json, error: 189589 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189589
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:58:59Z',
 'fuel_type': 'diesel',
 'id': 'c66706bc-507e-5dfa-b78e-cd56a4201012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA66568',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 189589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA66568%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [auto1.es] INFO: Saving data for CA66568: {'auction_closing_time': 1765040339.0, 'created_time': 1761127432.530654, 'last_price_update_time': 1764954370.516246}
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CA66568') HTTP/1.1" 204 0
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_1c8a2f2ba1a256f4ffe22a846b342e6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_1c8a2f2ba1a256f4ffe22a846b342e6f.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_2cc1d946469ed0bcb319a1aeb6e56799.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_2cc1d946469ed0bcb319a1aeb6e56799.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_67adea0104d4d98f73e6012a27edfbad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_67adea0104d4d98f73e6012a27edfbad.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_04f8d20cdd0c044684f5190cda39ff4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_04f8d20cdd0c044684f5190cda39ff4a.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_3f6d88b97dea303bc785b3ebd1bb319f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_3f6d88b97dea303bc785b3ebd1bb319f.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_9f27fcf6403437104342e47d424ee4d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_9f27fcf6403437104342e47d424ee4d4.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_8574fe6ac0ab60b5b8f43bb9350edb46.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_8574fe6ac0ab60b5b8f43bb9350edb46.jpg not downloaded yet
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU50952> (referer: https://www.auto1.com/v1/car-details-view/EU50952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_47686da8f3781b61f82b3eb7ba5063f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_47686da8f3781b61f82b3eb7ba5063f9.jpg not downloaded yet
2025-12-05 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_e356e9c0e6520bafd5625c594703858c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e356e9c0e6520bafd5625c594703858c.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_e70fac15abc68650b5fe6cf123364aea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e70fac15abc68650b5fe6cf123364aea.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_058ca6ec9685f36b3835c1db40b086a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_058ca6ec9685f36b3835c1db40b086a7.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_683664e3c3b3dfed988db99d523bc17d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_683664e3c3b3dfed988db99d523bc17d.jpg not downloaded yet
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_e4460afbfdc563d7398c70b9f396b43a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e4460afbfdc563d7398c70b9f396b43a.jpg not downloaded yet
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN60330> (referer: https://www.auto1.com/v1/car-details-view/LN60330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS24104> (referer: https://www.auto1.com/v1/car-details-view/CS24104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_ce5cfc6e3c544bba9e3a123ff7651e39.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_ce5cfc6e3c544bba9e3a123ff7651e39.jpg not downloaded yet
2025-12-05 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_8574fe6ac0ab60b5b8f43bb9350edb46.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1de5218-b4f3-50e8-aeeb-1660b7498394 with identifier: EU50952
2025-12-05 17:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1de5218-b4f3-50e8-aeeb-1660b7498394 with scrape type 2
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1de5218-b4f3-50e8-aeeb-1660b7498394 with scrape type 2
2025-12-05 17:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1de5218-b4f3-50e8-aeeb-1660b7498394, identifier: EU50952
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_290e44721107a478fa34d1915362a31d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_290e44721107a478fa34d1915362a31d.jpg not downloaded yet
2025-12-05 17:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1de5218-b4f3-50e8-aeeb-1660b7498394 with identifier: EU50952
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1de5218-b4f3-50e8-aeeb-1660b7498394 with identifier: EU50952
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d1de5218-b4f3-50e8-aeeb-1660b7498394 spider: auto1.es
2025-12-05 17:06:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d1de5218-b4f3-50e8-aeeb-1660b7498394 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:03:33Z',
 'fuel_type': 'electro',
 'id': 'd1de5218-b4f3-50e8-aeeb-1660b7498394',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU50952',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 26718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU50952%27 HTTP/1.1" 200 None
2025-12-05 17:06:11 [auto1.es] INFO: Saving data for EU50952: {'auction_closing_time': 1765037013.0, 'created_time': 1763398984.308439, 'last_price_update_time': 1764954371.119779}
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EU50952') HTTP/1.1" 204 0
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_58179e96798358f7fdec38ce8383144a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_58179e96798358f7fdec38ce8383144a.jpg not downloaded yet
2025-12-05 17:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cddb70b-3b57-5afd-b6be-5726dd5e3157 with identifier: LN60330
2025-12-05 17:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cddb70b-3b57-5afd-b6be-5726dd5e3157 with scrape type 2
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cddb70b-3b57-5afd-b6be-5726dd5e3157 with scrape type 2
2025-12-05 17:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cddb70b-3b57-5afd-b6be-5726dd5e3157, identifier: LN60330
2025-12-05 17:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e59d18-4acf-5a12-a293-6b69ec6b5d98 with identifier: CS24104
2025-12-05 17:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e59d18-4acf-5a12-a293-6b69ec6b5d98 with scrape type 2
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0e59d18-4acf-5a12-a293-6b69ec6b5d98 with scrape type 2
2025-12-05 17:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0e59d18-4acf-5a12-a293-6b69ec6b5d98, identifier: CS24104
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e80bd10>
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_8574fe6ac0ab60b5b8f43bb9350edb46.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_8574fe6ac0ab60b5b8f43bb9350edb46.jpg saved to cache
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF50859> (referer: https://www.auto1.com/v1/car-details-view/ZF50859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ69467> (referer: https://www.auto1.com/v1/car-details-view/LZ69467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX91885> (referer: https://www.auto1.com/v1/car-details-view/DX91885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cddb70b-3b57-5afd-b6be-5726dd5e3157 with identifier: LN60330
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cddb70b-3b57-5afd-b6be-5726dd5e3157 with identifier: LN60330
2025-12-05 17:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3cddb70b-3b57-5afd-b6be-5726dd5e3157 with identifier: LN60330 to the API
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LN60330>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:59:30Z',
 'fuel_type': 'petrol',
 'id': '3cddb70b-3b57-5afd-b6be-5726dd5e3157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN60330',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 70903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.2 e-THP Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2016}
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN60330%27 HTTP/1.1" 200 None
2025-12-05 17:06:11 [auto1.es] INFO: Saving data for LN60330: {'auction_closing_time': 1765040370.0, 'created_time': 1764396116.857672, 'last_price_update_time': 1764954371.894864}
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LN60330') HTTP/1.1" 204 0
2025-12-05 17:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0e59d18-4acf-5a12-a293-6b69ec6b5d98 with identifier: CS24104
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0e59d18-4acf-5a12-a293-6b69ec6b5d98 with identifier: CS24104
2025-12-05 17:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c0e59d18-4acf-5a12-a293-6b69ec6b5d98 with identifier: CS24104 to the API
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CS24104>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:34:17Z',
 'fuel_type': 'diesel',
 'id': 'c0e59d18-4acf-5a12-a293-6b69ec6b5d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS24104',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Mazda',
 'model': '3',
 'odometer': 149115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS24104%27 HTTP/1.1" 200 None
2025-12-05 17:06:12 [auto1.es] INFO: Saving data for CS24104: {'auction_closing_time': 1765038857.0, 'created_time': 1764608484.583092, 'last_price_update_time': 1764954372.272268}
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CS24104') HTTP/1.1" 204 0
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e4460afbfdc563d7398c70b9f396b43a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_058ca6ec9685f36b3835c1db40b086a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_683664e3c3b3dfed988db99d523bc17d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB64623> (referer: https://www.auto1.com/v1/car-details-view/RB64623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG14528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859
2025-12-05 17:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with scrape type 2
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with scrape type 2
2025-12-05 17:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e, identifier: ZF50859
2025-12-05 17:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5 with identifier: LZ69467
2025-12-05 17:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5 with scrape type 2
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5 with scrape type 2
2025-12-05 17:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5, identifier: LZ69467
2025-12-05 17:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cadf8a-e7c0-59cd-b240-e19642971ac4 with identifier: DX91885
2025-12-05 17:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cadf8a-e7c0-59cd-b240-e19642971ac4 with scrape type 2
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41cadf8a-e7c0-59cd-b240-e19642971ac4 with scrape type 2
2025-12-05 17:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 41cadf8a-e7c0-59cd-b240-e19642971ac4, identifier: DX91885
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859
2025-12-05 17:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859
2025-12-05 17:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859 to the API
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF50859>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:30:51Z',
 'fuel_type': 'diesel',
 'id': '1ed79263-0d3c-5f50-afe0-7155c8c0fa7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF50859',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 121190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D165 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF50859%27 HTTP/1.1" 200 None
2025-12-05 17:06:12 [auto1.es] INFO: Saving data for ZF50859: {'auction_closing_time': 1765038651.0, 'created_time': 1762880569.63503, 'last_price_update_time': 1764954372.938788}
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZF50859') HTTP/1.1" 204 0
2025-12-05 17:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5 with identifier: LZ69467
2025-12-05 17:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5 with identifier: LZ69467
2025-12-05 17:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5 with identifier: LZ69467 to the API
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ69467>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:59:12Z',
 'fuel_type': 'hybrid',
 'id': 'dd44b0a4-969c-5631-a6ea-3fdd8ea6dea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ69467',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 76571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 Allure',
 'transmission': 'automatic',
 'trim': '225 Allure',
 'year': 2021}
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ69467%27 HTTP/1.1" 200 None
2025-12-05 17:06:13 [auto1.es] INFO: Saving data for LZ69467: {'auction_closing_time': 1765040352.0, 'created_time': 1761584593.144573, 'last_price_update_time': 1764954373.569359}
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ69467') HTTP/1.1" 204 0
2025-12-05 17:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 41cadf8a-e7c0-59cd-b240-e19642971ac4 with identifier: DX91885
2025-12-05 17:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 41cadf8a-e7c0-59cd-b240-e19642971ac4 with identifier: DX91885
2025-12-05 17:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 41cadf8a-e7c0-59cd-b240-e19642971ac4 spider: auto1.es
2025-12-05 17:06:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 41cadf8a-e7c0-59cd-b240-e19642971ac4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:46:47Z',
 'fuel_type': 'diesel',
 'id': '41cadf8a-e7c0-59cd-b240-e19642971ac4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX91885',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 180049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX91885%27 HTTP/1.1" 200 None
2025-12-05 17:06:13 [auto1.es] INFO: Saving data for DX91885: {'auction_closing_time': 1765039607.0, 'created_time': 1762880525.87053, 'last_price_update_time': 1764954373.784252}
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX91885') HTTP/1.1" 204 0
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e70fac15abc68650b5fe6cf123364aea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e356e9c0e6520bafd5625c594703858c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_47686da8f3781b61f82b3eb7ba5063f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_290e44721107a478fa34d1915362a31d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_58179e96798358f7fdec38ce8383144a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_ce5cfc6e3c544bba9e3a123ff7651e39.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC20830> (referer: https://www.auto1.com/v1/car-details-view/UC20830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR85149> (referer: https://www.auto1.com/v1/car-details-view/NR85149/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da9a190>
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_e4460afbfdc563d7398c70b9f396b43a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e4460afbfdc563d7398c70b9f396b43a.jpg saved to cache
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d1450>
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_058ca6ec9685f36b3835c1db40b086a7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_058ca6ec9685f36b3835c1db40b086a7.jpg saved to cache
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a5790>
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_683664e3c3b3dfed988db99d523bc17d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_683664e3c3b3dfed988db99d523bc17d.jpg saved to cache
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 with identifier: RB64623
2025-12-05 17:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 with scrape type 2
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 with scrape type 2
2025-12-05 17:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4, identifier: RB64623
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_9f27fcf6403437104342e47d424ee4d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 with identifier: RB64623
2025-12-05 17:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 with identifier: RB64623
2025-12-05 17:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 spider: auto1.es
2025-12-05 17:06:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:30:05Z',
 'fuel_type': 'diesel',
 'id': 'bfa4f62b-0a8f-5ed8-b9bc-622f6bf83dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB64623',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 138362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2022}
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB64623%27 HTTP/1.1" 200 None
2025-12-05 17:06:14 [auto1.es] INFO: Saving data for RB64623: {'auction_closing_time': 1765038605.0, 'created_time': 1760979972.244323, 'last_price_update_time': 1764954374.944029}
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RB64623') HTTP/1.1" 204 0
2025-12-05 17:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_3f6d88b97dea303bc785b3ebd1bb319f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_04f8d20cdd0c044684f5190cda39ff4a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_67adea0104d4d98f73e6012a27edfbad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6db10>
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_e70fac15abc68650b5fe6cf123364aea.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e70fac15abc68650b5fe6cf123364aea.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e69a010>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_e356e9c0e6520bafd5625c594703858c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e356e9c0e6520bafd5625c594703858c.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d86fd10>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_47686da8f3781b61f82b3eb7ba5063f9.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_47686da8f3781b61f82b3eb7ba5063f9.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061a090>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_290e44721107a478fa34d1915362a31d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_290e44721107a478fa34d1915362a31d.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d905350>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_58179e96798358f7fdec38ce8383144a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_58179e96798358f7fdec38ce8383144a.jpg saved to cache
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c6c50>
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_ce5cfc6e3c544bba9e3a123ff7651e39.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_ce5cfc6e3c544bba9e3a123ff7651e39.jpg saved to cache
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0f30b4c-9f36-5676-846d-999627b61230 with identifier: UC20830
2025-12-05 17:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f30b4c-9f36-5676-846d-999627b61230 with scrape type 2
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0f30b4c-9f36-5676-846d-999627b61230 with scrape type 2
2025-12-05 17:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0f30b4c-9f36-5676-846d-999627b61230, identifier: UC20830
2025-12-05 17:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c9cb416-c46a-5ebf-be2d-863336085154 with identifier: NR85149
2025-12-05 17:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9cb416-c46a-5ebf-be2d-863336085154 with scrape type 2
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c9cb416-c46a-5ebf-be2d-863336085154 with scrape type 2
2025-12-05 17:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c9cb416-c46a-5ebf-be2d-863336085154, identifier: NR85149
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4dced0>
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_9f27fcf6403437104342e47d424ee4d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_9f27fcf6403437104342e47d424ee4d4.jpg saved to cache
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0f30b4c-9f36-5676-846d-999627b61230 with identifier: UC20830
2025-12-05 17:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0f30b4c-9f36-5676-846d-999627b61230 with identifier: UC20830
2025-12-05 17:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2025-12-05 17:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f0f30b4c-9f36-5676-846d-999627b61230 spider: auto1.es
2025-12-05 17:06:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f0f30b4c-9f36-5676-846d-999627b61230 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:44:34Z',
 'fuel_type': 'diesel',
 'id': 'f0f30b4c-9f36-5676-846d-999627b61230',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC20830',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 118017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC20830%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [auto1.es] INFO: Saving data for UC20830: {'auction_closing_time': 1765039474.0, 'created_time': 1760029372.365443, 'last_price_update_time': 1764954377.066654}
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC20830') HTTP/1.1" 204 0
2025-12-05 17:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c9cb416-c46a-5ebf-be2d-863336085154 with identifier: NR85149
2025-12-05 17:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c9cb416-c46a-5ebf-be2d-863336085154 with identifier: NR85149
2025-12-05 17:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192494 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192494
2025-12-05 17:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0c9cb416-c46a-5ebf-be2d-863336085154 spider: auto1.es
2025-12-05 17:06:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0c9cb416-c46a-5ebf-be2d-863336085154 due to rule: high_mileage_for_country.json, error: 192494 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192494
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:31:37Z',
 'fuel_type': 'diesel',
 'id': '0c9cb416-c46a-5ebf-be2d-863336085154',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR85149',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 192494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR85149%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [auto1.es] INFO: Saving data for NR85149: {'auction_closing_time': 1765038697.0, 'created_time': 1762880610.753918, 'last_price_update_time': 1764954377.296532}
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NR85149') HTTP/1.1" 204 0
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c9f10c496ea9da53e5d1f88152003f0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_52763d2e429cba6dad1ae696261796fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_d3af5fb503faf5f578c20a55b4c14375.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_1c8a2f2ba1a256f4ffe22a846b342e6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_2cc1d946469ed0bcb319a1aeb6e56799.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK00839> (referer: https://www.auto1.com/v1/car-details-view/RK00839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN30281> (referer: https://www.auto1.com/v1/car-details-view/EN30281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e67b210>
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_3f6d88b97dea303bc785b3ebd1bb319f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_3f6d88b97dea303bc785b3ebd1bb319f.jpg saved to cache
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b25d0>
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_04f8d20cdd0c044684f5190cda39ff4a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_04f8d20cdd0c044684f5190cda39ff4a.jpg saved to cache
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a1190>
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_67adea0104d4d98f73e6012a27edfbad.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_67adea0104d4d98f73e6012a27edfbad.jpg saved to cache
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da0ad10>
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_c9f10c496ea9da53e5d1f88152003f0f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c9f10c496ea9da53e5d1f88152003f0f.jpg saved to cache
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6064d0>
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_52763d2e429cba6dad1ae696261796fe.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_52763d2e429cba6dad1ae696261796fe.jpg saved to cache
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6d850>
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_d3af5fb503faf5f578c20a55b4c14375.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_d3af5fb503faf5f578c20a55b4c14375.jpg saved to cache
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f9b10>
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_1c8a2f2ba1a256f4ffe22a846b342e6f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_1c8a2f2ba1a256f4ffe22a846b342e6f.jpg saved to cache
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e69bf10>
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_2cc1d946469ed0bcb319a1aeb6e56799.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_2cc1d946469ed0bcb319a1aeb6e56799.jpg saved to cache
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6e190>
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F24%252F01246bcec367395b60c9b37c7a069c30%252Fpa%252FJT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg saved to cache
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8
2025-12-05 17:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8, skipping ID generation
2025-12-05 17:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 with scrape type 1
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 from tracking dictionaries
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 sending to next pipeline
2025-12-05 17:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8, identifier: JT67335
2025-12-05 17:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02 with identifier: RK00839
2025-12-05 17:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02 with scrape type 2
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02 with scrape type 2
2025-12-05 17:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02, identifier: RK00839
2025-12-05 17:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7836ce4-1230-5398-9762-87ddca840239 with identifier: EN30281
2025-12-05 17:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7836ce4-1230-5398-9762-87ddca840239 with scrape type 2
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7836ce4-1230-5398-9762-87ddca840239 with scrape type 2
2025-12-05 17:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7836ce4-1230-5398-9762-87ddca840239, identifier: EN30281
2025-12-05 17:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 with identifier: JT67335
2025-12-05 17:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 with identifier: JT67335
2025-12-05 17:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8 with identifier: JT67335 to the API
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 225,
 'expiration_date': '2025-12-06T16:56:52Z',
 'fuel_type': 'hybrid',
 'id': '6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT67335',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 96473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_52763d2e429cba6dad1ae696261796fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_d3af5fb503faf5f578c20a55b4c14375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c9f10c496ea9da53e5d1f88152003f0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_c298d4699e8c6f86d1e841b1c967fe7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_1c8a2f2ba1a256f4ffe22a846b342e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_2cc1d946469ed0bcb319a1aeb6e56799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_67adea0104d4d98f73e6012a27edfbad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_04f8d20cdd0c044684f5190cda39ff4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_3f6d88b97dea303bc785b3ebd1bb319f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_9f27fcf6403437104342e47d424ee4d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_8574fe6ac0ab60b5b8f43bb9350edb46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_47686da8f3781b61f82b3eb7ba5063f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e356e9c0e6520bafd5625c594703858c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e70fac15abc68650b5fe6cf123364aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36241,
             'Height': 538,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_058ca6ec9685f36b3835c1db40b086a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_683664e3c3b3dfed988db99d523bc17d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_e4460afbfdc563d7398c70b9f396b43a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_ce5cfc6e3c544bba9e3a123ff7651e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_290e44721107a478fa34d1915362a31d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8/6b7f48a7-6bf7-5d13-b2f5-218f9b344ee8_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/24/01246bcec367395b60c9b37c7a069c30/pa/JT67335_58179e96798358f7fdec38ce8383144a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2018}
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT67335%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [auto1.es] INFO: Saving data for JT67335: {'created_time': 1764954380.215886, 'last_price_update_time': 1764954380.215896, 'auction_closing_time': 1765040212.0}
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JT67335') HTTP/1.1" 204 0
2025-12-05 17:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02 with identifier: RK00839
2025-12-05 17:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02 with identifier: RK00839
2025-12-05 17:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 66d4d65c-a575-5aeb-a2d6-fb8b124e0b02 with identifier: RK00839 to the API
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK00839>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 177,
 'expiration_date': '2025-12-06T16:51:30Z',
 'fuel_type': 'diesel',
 'id': '66d4d65c-a575-5aeb-a2d6-fb8b124e0b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK00839',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 149551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK00839%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [auto1.es] INFO: Saving data for RK00839: {'auction_closing_time': 1765039890.0, 'created_time': 1761217344.720806, 'last_price_update_time': 1764954380.537323}
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK00839') HTTP/1.1" 204 0
2025-12-05 17:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7836ce4-1230-5398-9762-87ddca840239 with identifier: EN30281
2025-12-05 17:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7836ce4-1230-5398-9762-87ddca840239 with identifier: EN30281
2025-12-05 17:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2025-12-05 17:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e7836ce4-1230-5398-9762-87ddca840239 spider: auto1.es
2025-12-05 17:06:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e7836ce4-1230-5398-9762-87ddca840239 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:07:43Z',
 'fuel_type': 'electro',
 'id': 'e7836ce4-1230-5398-9762-87ddca840239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN30281',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 31440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2025-12-05 17:06:21 [auto1.es] INFO: Saving data for EN30281: {'auction_closing_time': 1765037263.0, 'created_time': 1763034761.274857, 'last_price_update_time': 1764954381.45144}
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN30281') HTTP/1.1" 204 0
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN26458> (referer: https://www.auto1.com/v1/car-details-view/DN26458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG14528> (referer: https://www.auto1.com/v1/car-details-view/XG14528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY38096> (referer: https://www.auto1.com/v1/car-details-view/TY38096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP28290> (referer: https://www.auto1.com/v1/car-details-view/LP28290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC18749> (referer: https://www.auto1.com/v1/car-details-view/SC18749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a552373-8632-50a1-a637-4bb07556cb54 with identifier: DN26458
2025-12-05 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a552373-8632-50a1-a637-4bb07556cb54 with scrape type 2
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a552373-8632-50a1-a637-4bb07556cb54 with scrape type 2
2025-12-05 17:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7a552373-8632-50a1-a637-4bb07556cb54, identifier: DN26458
2025-12-05 17:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with identifier: XG14528
2025-12-05 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with scrape type 2
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with scrape type 2
2025-12-05 17:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793, identifier: XG14528
2025-12-05 17:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037eeee3-720e-5078-a6dd-d4959a8a93bf with identifier: TY38096
2025-12-05 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037eeee3-720e-5078-a6dd-d4959a8a93bf with scrape type 2
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 037eeee3-720e-5078-a6dd-d4959a8a93bf with scrape type 2
2025-12-05 17:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 037eeee3-720e-5078-a6dd-d4959a8a93bf, identifier: TY38096
2025-12-05 17:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7a552373-8632-50a1-a637-4bb07556cb54 with identifier: DN26458
2025-12-05 17:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7a552373-8632-50a1-a637-4bb07556cb54 with identifier: DN26458
2025-12-05 17:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2025-12-05 17:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7a552373-8632-50a1-a637-4bb07556cb54 spider: auto1.es
2025-12-05 17:06:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7a552373-8632-50a1-a637-4bb07556cb54 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:46:48Z',
 'fuel_type': 'diesel',
 'id': '7a552373-8632-50a1-a637-4bb07556cb54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN26458',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 87286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2022}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN26458%27 HTTP/1.1" 200 None
2025-12-05 17:06:22 [auto1.es] INFO: Saving data for DN26458: {'auction_closing_time': 1765039608.0, 'created_time': 1762967061.272674, 'last_price_update_time': 1764954382.083292}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DN26458') HTTP/1.1" 204 0
2025-12-05 17:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with identifier: XG14528
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with identifier: XG14528
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 spider: auto1.es
2025-12-05 17:06:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:04:45Z',
 'fuel_type': 'diesel',
 'id': '9fc13fd7-cd6d-558a-9f2d-b3e1583b3793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG14528',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 195835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Access L1',
 'transmission': 'manual',
 'trim': 'Access L1',
 'year': 2020}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG14528%27 HTTP/1.1" 200 None
2025-12-05 17:06:22 [auto1.es] INFO: Saving data for XG14528: {'auction_closing_time': 1765037085.0, 'created_time': 1762880612.257504, 'last_price_update_time': 1764954382.346988}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XG14528') HTTP/1.1" 204 0
2025-12-05 17:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 037eeee3-720e-5078-a6dd-d4959a8a93bf with identifier: TY38096
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 037eeee3-720e-5078-a6dd-d4959a8a93bf with identifier: TY38096
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 037eeee3-720e-5078-a6dd-d4959a8a93bf spider: auto1.es
2025-12-05 17:06:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 037eeee3-720e-5078-a6dd-d4959a8a93bf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:55:55Z',
 'fuel_type': 'diesel',
 'id': '037eeee3-720e-5078-a6dd-d4959a8a93bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY38096',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 158132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY38096%27 HTTP/1.1" 200 None
2025-12-05 17:06:22 [auto1.es] INFO: Saving data for TY38096: {'auction_closing_time': 1765040155.0, 'created_time': 1757524108.661201, 'last_price_update_time': 1764954382.572982}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TY38096') HTTP/1.1" 204 0
2025-12-05 17:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d with identifier: LP28290
2025-12-05 17:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d with scrape type 2
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d with scrape type 2
2025-12-05 17:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d, identifier: LP28290
2025-12-05 17:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8605cdb-12e0-5952-92ff-2c92fca5618d with identifier: SC18749
2025-12-05 17:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8605cdb-12e0-5952-92ff-2c92fca5618d with scrape type 2
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8605cdb-12e0-5952-92ff-2c92fca5618d with scrape type 2
2025-12-05 17:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8605cdb-12e0-5952-92ff-2c92fca5618d, identifier: SC18749
2025-12-05 17:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d with identifier: LP28290
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d with identifier: LP28290
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d spider: auto1.es
2025-12-05 17:06:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:44:22Z',
 'fuel_type': 'diesel',
 'id': '6b87ff1a-8ec7-5a5f-99c6-d5f314985a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP28290',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 126837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP28290%27 HTTP/1.1" 200 None
2025-12-05 17:06:22 [auto1.es] INFO: Saving data for LP28290: {'auction_closing_time': 1765039462.0, 'created_time': 1762880566.426856, 'last_price_update_time': 1764954382.985864}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP28290') HTTP/1.1" 204 0
2025-12-05 17:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8605cdb-12e0-5952-92ff-2c92fca5618d with identifier: SC18749
2025-12-05 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8605cdb-12e0-5952-92ff-2c92fca5618d with identifier: SC18749
2025-12-05 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e8605cdb-12e0-5952-92ff-2c92fca5618d spider: auto1.es
2025-12-05 17:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e8605cdb-12e0-5952-92ff-2c92fca5618d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:26:34Z',
 'fuel_type': 'diesel',
 'id': 'e8605cdb-12e0-5952-92ff-2c92fca5618d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC18749',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 105124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC18749%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [auto1.es] INFO: Saving data for SC18749: {'auction_closing_time': 1765038394.0, 'created_time': 1762880583.268694, 'last_price_update_time': 1764954383.22778}
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SC18749') HTTP/1.1" 204 0
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW56639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA94679> (referer: https://www.auto1.com/v1/car-details-view/YA94679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 with identifier: YA94679
2025-12-05 17:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7c8ad0-0085-587a-b001-317cc3af5be1 with scrape type 1
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_5f5bd5206c3f34ffde11301281346332.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_5f5bd5206c3f34ffde11301281346332.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_aa9f1c4fd8e6833abbe4b514dc65b8d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_aa9f1c4fd8e6833abbe4b514dc65b8d9.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_62d2adc7d43cbb8411678c1b942e3c67.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_62d2adc7d43cbb8411678c1b942e3c67.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_cb91ac4b6923bbd98ff4b47f98a1f2b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cb91ac4b6923bbd98ff4b47f98a1f2b8.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_cd6221b4cb359c2b6f5871587b1b148c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cd6221b4cb359c2b6f5871587b1b148c.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_7b35f7f0a5bc4c847ba21753d93bbb42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_7b35f7f0a5bc4c847ba21753d93bbb42.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_672f99637bf0a915473423f5ef6ae881.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_672f99637bf0a915473423f5ef6ae881.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_f27bdfc500c8f3783b88262960cfbc48.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f27bdfc500c8f3783b88262960cfbc48.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_f9f50bd5a3cdf1b9b3bdfd13925483e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f9f50bd5a3cdf1b9b3bdfd13925483e4.jpg not downloaded yet
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU89258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_610ce2fffb9ee80f116c344e2341af16.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_610ce2fffb9ee80f116c344e2341af16.jpg not downloaded yet
2025-12-05 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_c2c1c669361cf6ac1b723952f0c2a861.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_c2c1c669361cf6ac1b723952f0c2a861.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_31febd132a8237b56a9e99893e4db7ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_31febd132a8237b56a9e99893e4db7ed.jpg not downloaded yet
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD96129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_f4c933eff74cb5b1000a8a2b3d208955.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f4c933eff74cb5b1000a8a2b3d208955.jpg not downloaded yet
2025-12-05 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_a63101e75e1a4643381415187b9425f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_a63101e75e1a4643381415187b9425f9.jpg not downloaded yet
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f9f50bd5a3cdf1b9b3bdfd13925483e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_80398a39d2a0f8d130960be5e08a1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_80398a39d2a0f8d130960be5e08a1002.jpg not downloaded yet
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_2e6bfeecedb1e5a9f43680245e6d2c47.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_2e6bfeecedb1e5a9f43680245e6d2c47.jpg not downloaded yet
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX68125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_31febd132a8237b56a9e99893e4db7ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_a63101e75e1a4643381415187b9425f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB76266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d71d0>
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_f9f50bd5a3cdf1b9b3bdfd13925483e4.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f9f50bd5a3cdf1b9b3bdfd13925483e4.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_80398a39d2a0f8d130960be5e08a1002.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_2e6bfeecedb1e5a9f43680245e6d2c47.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ90079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e57f610>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_31febd132a8237b56a9e99893e4db7ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_31febd132a8237b56a9e99893e4db7ed.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc26150>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_a63101e75e1a4643381415187b9425f9.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_a63101e75e1a4643381415187b9425f9.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ00657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ73494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV26148> (referer: https://www.auto1.com/v1/car-details-view/LV26148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e06d0>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_80398a39d2a0f8d130960be5e08a1002.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_80398a39d2a0f8d130960be5e08a1002.jpg saved to cache
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d2cd0>
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_2e6bfeecedb1e5a9f43680245e6d2c47.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_2e6bfeecedb1e5a9f43680245e6d2c47.jpg saved to cache
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_c2c1c669361cf6ac1b723952f0c2a861.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f4c933eff74cb5b1000a8a2b3d208955.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_610ce2fffb9ee80f116c344e2341af16.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ98968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU13655> (referer: https://www.auto1.com/v1/car-details-view/WU13655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:25 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45f63ed-a399-52dc-9d16-fbb4159241b7 with identifier: LV26148
2025-12-05 17:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45f63ed-a399-52dc-9d16-fbb4159241b7 with scrape type 2
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a45f63ed-a399-52dc-9d16-fbb4159241b7 with scrape type 2
2025-12-05 17:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a45f63ed-a399-52dc-9d16-fbb4159241b7, identifier: LV26148
2025-12-05 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a45f63ed-a399-52dc-9d16-fbb4159241b7 with identifier: LV26148
2025-12-05 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a45f63ed-a399-52dc-9d16-fbb4159241b7 with identifier: LV26148
2025-12-05 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185360 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185360
2025-12-05 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a45f63ed-a399-52dc-9d16-fbb4159241b7 spider: auto1.es
2025-12-05 17:06:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a45f63ed-a399-52dc-9d16-fbb4159241b7 due to rule: high_mileage_for_country.json, error: 185360 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185360
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.9L',
 'engine_horse_power': 285,
 'expiration_date': '2025-12-06T16:07:33Z',
 'fuel_type': 'diesel',
 'id': 'a45f63ed-a399-52dc-9d16-fbb4159241b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV26148',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 185360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV26148%27 HTTP/1.1" 200 None
2025-12-05 17:06:25 [auto1.es] INFO: Saving data for LV26148: {'auction_closing_time': 1765037253.0, 'created_time': 1760594454.359101, 'last_price_update_time': 1764954385.766752}
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV26148') HTTP/1.1" 204 0
2025-12-05 17:06:25 [auto1.es] INFO: Found listing with ID: DD33656
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD33656%27 HTTP/1.1" 200 None
2025-12-05 17:06:25 [auto1.es] INFO: Scrape type for DD33656: 2
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f27bdfc500c8f3783b88262960cfbc48.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_672f99637bf0a915473423f5ef6ae881.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:25 [auto1.es] INFO: Found listing with ID: HG40142
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG40142%27 HTTP/1.1" 200 None
2025-12-05 17:06:25 [auto1.es] INFO: Scrape type for HG40142: 2
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6fb250>
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_c2c1c669361cf6ac1b723952f0c2a861.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_c2c1c669361cf6ac1b723952f0c2a861.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061b910>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_f4c933eff74cb5b1000a8a2b3d208955.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f4c933eff74cb5b1000a8a2b3d208955.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7be50>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_610ce2fffb9ee80f116c344e2341af16.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_610ce2fffb9ee80f116c344e2341af16.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af551196-4131-5284-bb07-ea9e0bf03042 with identifier: WU13655
2025-12-05 17:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af551196-4131-5284-bb07-ea9e0bf03042 with scrape type 2
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af551196-4131-5284-bb07-ea9e0bf03042 with scrape type 2
2025-12-05 17:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af551196-4131-5284-bb07-ea9e0bf03042, identifier: WU13655
2025-12-05 17:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af551196-4131-5284-bb07-ea9e0bf03042 with identifier: WU13655
2025-12-05 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af551196-4131-5284-bb07-ea9e0bf03042 with identifier: WU13655
2025-12-05 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2025-12-05 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: af551196-4131-5284-bb07-ea9e0bf03042 spider: auto1.es
2025-12-05 17:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: af551196-4131-5284-bb07-ea9e0bf03042 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:19:21Z',
 'fuel_type': 'diesel',
 'id': 'af551196-4131-5284-bb07-ea9e0bf03042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU13655',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 179968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2025-12-05 17:06:26 [auto1.es] INFO: Saving data for WU13655: {'auction_closing_time': 1765037961.0, 'created_time': 1764064949.883839, 'last_price_update_time': 1764954386.842285}
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU13655') HTTP/1.1" 204 0
2025-12-05 17:06:26 [auto1.es] INFO: Found listing with ID: TB40361
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB40361%27 HTTP/1.1" 200 None
2025-12-05 17:06:26 [auto1.es] INFO: Scrape type for TB40361: 2
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_7b35f7f0a5bc4c847ba21753d93bbb42.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cd6221b4cb359c2b6f5871587b1b148c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_62d2adc7d43cbb8411678c1b942e3c67.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cb91ac4b6923bbd98ff4b47f98a1f2b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD16750> (referer: https://www.auto1.com/v1/car-details-view/DD16750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc20ed0>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_f27bdfc500c8f3783b88262960cfbc48.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f27bdfc500c8f3783b88262960cfbc48.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc21990>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_672f99637bf0a915473423f5ef6ae881.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_672f99637bf0a915473423f5ef6ae881.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:27 [auto1.es] INFO: Found listing with ID: EC96824
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC96824%27 HTTP/1.1" 200 None
2025-12-05 17:06:27 [auto1.es] INFO: Scrape type for EC96824: 2
2025-12-05 17:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:27 [auto1.es] INFO: Found listing with ID: ZE49879
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE49879%27 HTTP/1.1" 200 None
2025-12-05 17:06:27 [auto1.es] INFO: Scrape type for ZE49879: 2
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba2a90>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_7b35f7f0a5bc4c847ba21753d93bbb42.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_7b35f7f0a5bc4c847ba21753d93bbb42.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbddc90>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_cd6221b4cb359c2b6f5871587b1b148c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cd6221b4cb359c2b6f5871587b1b148c.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6f390>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_62d2adc7d43cbb8411678c1b942e3c67.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_62d2adc7d43cbb8411678c1b942e3c67.jpg saved to cache
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d6b50>
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_cb91ac4b6923bbd98ff4b47f98a1f2b8.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cb91ac4b6923bbd98ff4b47f98a1f2b8.jpg saved to cache
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0620dd-9c90-5079-9e10-3a8c1b4cf005 with identifier: DD16750
2025-12-05 17:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0620dd-9c90-5079-9e10-3a8c1b4cf005 with scrape type 2
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0620dd-9c90-5079-9e10-3a8c1b4cf005 with scrape type 2
2025-12-05 17:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e0620dd-9c90-5079-9e10-3a8c1b4cf005, identifier: DD16750
2025-12-05 17:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e0620dd-9c90-5079-9e10-3a8c1b4cf005 with identifier: DD16750
2025-12-05 17:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e0620dd-9c90-5079-9e10-3a8c1b4cf005 with identifier: DD16750
2025-12-05 17:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2e0620dd-9c90-5079-9e10-3a8c1b4cf005 with identifier: DD16750 to the API
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DD16750>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:16:10Z',
 'fuel_type': 'diesel',
 'id': '2e0620dd-9c90-5079-9e10-3a8c1b4cf005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD16750',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 59594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD16750%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Saving data for DD16750: {'auction_closing_time': 1765037770.0, 'created_time': 1762260414.345044, 'last_price_update_time': 1764954388.6796}
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD16750') HTTP/1.1" 204 0
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: RS77916
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS77916%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for RS77916: 2
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU89258> (referer: https://www.auto1.com/v1/car-details-view/SU89258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC38257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB59454> (referer: https://www.auto1.com/v1/car-details-view/KB59454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ79788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW56639> (referer: https://www.auto1.com/v1/car-details-view/AW56639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: ZN73910
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN73910%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for ZN73910: 1
2025-12-05 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD96129> (referer: https://www.auto1.com/v1/car-details-view/GD96129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: ZN11011
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN11011%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for ZN11011: 1
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: EB37326
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB37326%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for EB37326: 2
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: EG46057
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG46057%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for EG46057: 1
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: KX91354
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX91354%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for KX91354: 2
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: TF09128
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF09128%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for TF09128: 2
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_5f5bd5206c3f34ffde11301281346332.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:28 [auto1.es] INFO: Found listing with ID: WG59071
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [auto1.es] INFO: Scrape type for WG59071: 2
2025-12-05 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_aa9f1c4fd8e6833abbe4b514dc65b8d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3d20c4-09bd-546c-a4ae-3aad3f251498 with identifier: SU89258
2025-12-05 17:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3d20c4-09bd-546c-a4ae-3aad3f251498 with scrape type 2
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3d20c4-09bd-546c-a4ae-3aad3f251498 with scrape type 2
2025-12-05 17:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cc3d20c4-09bd-546c-a4ae-3aad3f251498, identifier: SU89258
2025-12-05 17:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe010b7-7af6-5bdb-b699-858d4f6d6ee8 with identifier: KB59454
2025-12-05 17:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe010b7-7af6-5bdb-b699-858d4f6d6ee8 with scrape type 1
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item bfe010b7-7af6-5bdb-b699-858d4f6d6ee8
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_83704953def3ab516693087e40193fc1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_83704953def3ab516693087e40193fc1.jpg already downloaded
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_48c5f89f61ae7506231391ef17f68e00.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_48c5f89f61ae7506231391ef17f68e00.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_154a208588658213e97221599c14ed35.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_154a208588658213e97221599c14ed35.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_c401e810171fcc52050d5b45e8bd3303.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_c401e810171fcc52050d5b45e8bd3303.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_d0073fa64b0e82e9bb5073beae525504.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_d0073fa64b0e82e9bb5073beae525504.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_6f8ff31beade5279a75241c4f8117e56.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_6f8ff31beade5279a75241c4f8117e56.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_dd5963f66802cdc952b1988f74acb0f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_dd5963f66802cdc952b1988f74acb0f2.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_a10108f0836d2083d42f5401cd71c63c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_a10108f0836d2083d42f5401cd71c63c.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_0ffb341bf9104306ea56c9603e4f5831.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_0ffb341bf9104306ea56c9603e4f5831.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_9857cfe3c4c0347c3a5222956c32d841.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_9857cfe3c4c0347c3a5222956c32d841.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_2f19a4b54e297086b423154b0140ba1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_2f19a4b54e297086b423154b0140ba1d.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_15a61f02015916362f52228c4f5a2742.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_15a61f02015916362f52228c4f5a2742.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_2d48574cf0f96d710d8fbfb5f4e8e5e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_2d48574cf0f96d710d8fbfb5f4e8e5e5.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_cd65a4dc28780efeb8162992769b3aff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_cd65a4dc28780efeb8162992769b3aff.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_bd1babce7c2a2c6bf58268d84cc0121d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_bd1babce7c2a2c6bf58268d84cc0121d.jpg already downloaded
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb7105327606e9eee9f86f3e54c2e9302%252Fpa%252FKB59454_31424dc40c27e9d353fc62f0b4049d9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_31424dc40c27e9d353fc62f0b4049d9c.jpg already downloaded
2025-12-05 17:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfe010b7-7af6-5bdb-b699-858d4f6d6ee8, identifier: KB59454
2025-12-05 17:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be8d206b-4586-506c-8774-17dd6a33ffc7 with identifier: AW56639
2025-12-05 17:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be8d206b-4586-506c-8774-17dd6a33ffc7 with scrape type 2
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be8d206b-4586-506c-8774-17dd6a33ffc7 with scrape type 2
2025-12-05 17:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be8d206b-4586-506c-8774-17dd6a33ffc7, identifier: AW56639
2025-12-05 17:06:29 [auto1.es] INFO: Found listing with ID: WT96929
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT96929%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [auto1.es] INFO: Scrape type for WT96929: 2
2025-12-05 17:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cc3d20c4-09bd-546c-a4ae-3aad3f251498 with identifier: SU89258
2025-12-05 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cc3d20c4-09bd-546c-a4ae-3aad3f251498 with identifier: SU89258
2025-12-05 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati levante 2.0 turbo mild-hybrid gt', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'levante', 'transmission': 'automatic', 'odometer': 109311, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/su89258', 'expiration_date': '2025-12-06t16:32:27z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 330, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '2.0l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'cc3d20c4-09bd-546c-a4ae-3aad3f251498', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'maserati levante', 'sanitized_make': 'maserati', 'odometer_in_km': 109311}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'engine_horse_power': 330,
     'expiration_date': '2025-12-06t16:32:27z',
     'fuel_type': 'petrol',
     'id': 'cc3d20c4-09bd-546c-a4ae-3aad3f251498',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/su89258',
     'listing': 'auction',
     'location': 'es',
     'make': 'maserati',
     'make_model': 'maserati levante',
     'model': 'levante',
     'odometer': 109311,
     'odometer_in_km': 109311,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-10-13',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati levante 2.0 turbo mild-hybrid gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
2025-12-05 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: cc3d20c4-09bd-546c-a4ae-3aad3f251498 spider: auto1.es
2025-12-05 17:06:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cc3d20c4-09bd-546c-a4ae-3aad3f251498 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati levante 2.0 turbo mild-hybrid gt', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'levante', 'transmission': 'automatic', 'odometer': 109311, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/su89258', 'expiration_date': '2025-12-06t16:32:27z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 330, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '2.0l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'cc3d20c4-09bd-546c-a4ae-3aad3f251498', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'maserati levante', 'sanitized_make': 'maserati', 'odometer_in_km': 109311}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'engine_horse_power': 330,
     'expiration_date': '2025-12-06t16:32:27z',
     'fuel_type': 'petrol',
     'id': 'cc3d20c4-09bd-546c-a4ae-3aad3f251498',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/su89258',
     'listing': 'auction',
     'location': 'es',
     'make': 'maserati',
     'make_model': 'maserati levante',
     'model': 'levante',
     'odometer': 109311,
     'odometer_in_km': 109311,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-10-13',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati levante 2.0 turbo mild-hybrid gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 330,
 'expiration_date': '2025-12-06T16:32:27Z',
 'fuel_type': 'petrol',
 'id': 'cc3d20c4-09bd-546c-a4ae-3aad3f251498',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU89258',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 109311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 2.0 Turbo Mild-Hybrid GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU89258%27 HTTP/1.1" 200 None
2025-12-05 17:06:29 [auto1.es] INFO: Saving data for SU89258: {'auction_closing_time': 1765038747.0, 'created_time': 1762880485.665565, 'last_price_update_time': 1764954389.6464}
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU89258') HTTP/1.1" 204 0
2025-12-05 17:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfe010b7-7af6-5bdb-b699-858d4f6d6ee8 with identifier: KB59454
2025-12-05 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfe010b7-7af6-5bdb-b699-858d4f6d6ee8 with identifier: KB59454
2025-12-05 17:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bfe010b7-7af6-5bdb-b699-858d4f6d6ee8 with identifier: KB59454 to the API
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB59454>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:01:23Z',
 'fuel_type': 'petrol',
 'id': 'bfe010b7-7af6-5bdb-b699-858d4f6d6ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB59454',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 28819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_83704953def3ab516693087e40193fc1.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_48c5f89f61ae7506231391ef17f68e00.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_154a208588658213e97221599c14ed35.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_c401e810171fcc52050d5b45e8bd3303.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_d0073fa64b0e82e9bb5073beae525504.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_6f8ff31beade5279a75241c4f8117e56.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_dd5963f66802cdc952b1988f74acb0f2.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_a10108f0836d2083d42f5401cd71c63c.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_0ffb341bf9104306ea56c9603e4f5831.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_9857cfe3c4c0347c3a5222956c32d841.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_2f19a4b54e297086b423154b0140ba1d.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_15a61f02015916362f52228c4f5a2742.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_2d48574cf0f96d710d8fbfb5f4e8e5e5.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_cd65a4dc28780efeb8162992769b3aff.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_bd1babce7c2a2c6bf58268d84cc0121d.jpg',
                'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_31424dc40c27e9d353fc62f0b4049d9c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_83704953def3ab516693087e40193fc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_48c5f89f61ae7506231391ef17f68e00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_154a208588658213e97221599c14ed35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_c401e810171fcc52050d5b45e8bd3303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_d0073fa64b0e82e9bb5073beae525504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_6f8ff31beade5279a75241c4f8117e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_dd5963f66802cdc952b1988f74acb0f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_a10108f0836d2083d42f5401cd71c63c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_0ffb341bf9104306ea56c9603e4f5831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_9857cfe3c4c0347c3a5222956c32d841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_2f19a4b54e297086b423154b0140ba1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_15a61f02015916362f52228c4f5a2742.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_2d48574cf0f96d710d8fbfb5f4e8e5e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_cd65a4dc28780efeb8162992769b3aff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_bd1babce7c2a2c6bf58268d84cc0121d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe010b7-7af6-5bdb-b699-858d4f6d6ee8/bfe010b7-7af6-5bdb-b699-858d4f6d6ee8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b7105327606e9eee9f86f3e54c2e9302/pa/KB59454_31424dc40c27e9d353fc62f0b4049d9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB59454%27 HTTP/1.1" 200 None
2025-12-05 17:06:30 [auto1.es] INFO: Saving data for KB59454: {'created_time': 1764954390.107211, 'last_price_update_time': 1764954390.10722, 'auction_closing_time': 1765036883.0}
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KB59454') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be8d206b-4586-506c-8774-17dd6a33ffc7 with identifier: AW56639
2025-12-05 17:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be8d206b-4586-506c-8774-17dd6a33ffc7 with identifier: AW56639
2025-12-05 17:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be8d206b-4586-506c-8774-17dd6a33ffc7 with identifier: AW56639 to the API
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW56639>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:46:15Z',
 'fuel_type': 'diesel',
 'id': 'be8d206b-4586-506c-8774-17dd6a33ffc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW56639',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW56639%27 HTTP/1.1" 200 None
2025-12-05 17:06:30 [auto1.es] INFO: Saving data for AW56639: {'auction_closing_time': 1765039575.0, 'created_time': 1764781447.930931, 'last_price_update_time': 1764954390.439126}
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AW56639') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc8dd59-d455-52e6-a855-aad75d840de8 with identifier: GD96129
2025-12-05 17:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc8dd59-d455-52e6-a855-aad75d840de8 with scrape type 1
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_fff7a6779fa6c7e7c0b098ee787e1096.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_fff7a6779fa6c7e7c0b098ee787e1096.jpg not downloaded yet
2025-12-05 17:06:30 [auto1.es] INFO: Found listing with ID: MM47502
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM47502%27 HTTP/1.1" 200 None
2025-12-05 17:06:30 [auto1.es] INFO: Scrape type for MM47502: 1
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_b6108dfca1d2eae6e48a46af23a866dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b6108dfca1d2eae6e48a46af23a866dd.jpg not downloaded yet
2025-12-05 17:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB76266> (referer: https://www.auto1.com/v1/car-details-view/SB76266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da17690>
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_5f5bd5206c3f34ffde11301281346332.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_5f5bd5206c3f34ffde11301281346332.jpg saved to cache
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e503790>
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F55%252Fc055ebb3a2fb4aee0d8bbbebae222abc%252Fpa%252FYA94679_aa9f1c4fd8e6833abbe4b514dc65b8d9.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_aa9f1c4fd8e6833abbe4b514dc65b8d9.jpg saved to cache
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a7c8ad0-0085-587a-b001-317cc3af5be1
2025-12-05 17:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a7c8ad0-0085-587a-b001-317cc3af5be1, skipping ID generation
2025-12-05 17:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7c8ad0-0085-587a-b001-317cc3af5be1 with scrape type 1
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a7c8ad0-0085-587a-b001-317cc3af5be1 from tracking dictionaries
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a7c8ad0-0085-587a-b001-317cc3af5be1 sending to next pipeline
2025-12-05 17:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a7c8ad0-0085-587a-b001-317cc3af5be1, identifier: YA94679
2025-12-05 17:06:31 [auto1.es] INFO: Found listing with ID: CN52175
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN52175%27 HTTP/1.1" 200 None
2025-12-05 17:06:31 [auto1.es] INFO: Scrape type for CN52175: 2
2025-12-05 17:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 with identifier: YA94679
2025-12-05 17:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 with identifier: YA94679
2025-12-05 17:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185449 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185449
2025-12-05 17:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 spider: auto1.es
2025-12-05 17:06:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3a7c8ad0-0085-587a-b001-317cc3af5be1 due to rule: high_mileage_for_country.json, error: 185449 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185449
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:54:39Z',
 'fuel_type': 'petrol',
 'id': '3a7c8ad0-0085-587a-b001-317cc3af5be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA94679',
 'listing': 'auction',
 'location': 'ES, Lugo',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 185449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_5f5bd5206c3f34ffde11301281346332.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_aa9f1c4fd8e6833abbe4b514dc65b8d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_62d2adc7d43cbb8411678c1b942e3c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cb91ac4b6923bbd98ff4b47f98a1f2b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_cd6221b4cb359c2b6f5871587b1b148c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_7b35f7f0a5bc4c847ba21753d93bbb42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_672f99637bf0a915473423f5ef6ae881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f27bdfc500c8f3783b88262960cfbc48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f9f50bd5a3cdf1b9b3bdfd13925483e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_610ce2fffb9ee80f116c344e2341af16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_c2c1c669361cf6ac1b723952f0c2a861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_31febd132a8237b56a9e99893e4db7ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_f4c933eff74cb5b1000a8a2b3d208955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_a63101e75e1a4643381415187b9425f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_80398a39d2a0f8d130960be5e08a1002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7c8ad0-0085-587a-b001-317cc3af5be1/3a7c8ad0-0085-587a-b001-317cc3af5be1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/55/c055ebb3a2fb4aee0d8bbbebae222abc/pa/YA94679_2e6bfeecedb1e5a9f43680245e6d2c47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA94679%27 HTTP/1.1" 200 None
2025-12-05 17:06:31 [auto1.es] INFO: Saving data for YA94679: {'created_time': 1764954391.598373, 'last_price_update_time': 1764954391.598385, 'auction_closing_time': 1765040079.0}
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YA94679') HTTP/1.1" 204 0
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_783596f8d7165895490ae093d03a1571.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_783596f8d7165895490ae093d03a1571.jpg not downloaded yet
2025-12-05 17:06:31 [auto1.es] INFO: Found listing with ID: ET16826
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET16826%27 HTTP/1.1" 200 None
2025-12-05 17:06:31 [auto1.es] INFO: Scrape type for ET16826: 2
2025-12-05 17:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 231a0987-938f-5973-bbbd-3b8d3ff0c386 with identifier: SB76266
2025-12-05 17:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 231a0987-938f-5973-bbbd-3b8d3ff0c386 with scrape type 2
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 231a0987-938f-5973-bbbd-3b8d3ff0c386 with scrape type 2
2025-12-05 17:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 231a0987-938f-5973-bbbd-3b8d3ff0c386, identifier: SB76266
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_df374f87d757f5ec6ad7170dbfacd366.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_df374f87d757f5ec6ad7170dbfacd366.jpg not downloaded yet
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX68125> (referer: https://www.auto1.com/v1/car-details-view/RX68125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 231a0987-938f-5973-bbbd-3b8d3ff0c386 with identifier: SB76266
2025-12-05 17:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 231a0987-938f-5973-bbbd-3b8d3ff0c386 with identifier: SB76266
2025-12-05 17:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2025-12-05 17:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 231a0987-938f-5973-bbbd-3b8d3ff0c386 spider: auto1.es
2025-12-05 17:06:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 231a0987-938f-5973-bbbd-3b8d3ff0c386 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:40:00Z',
 'fuel_type': 'diesel',
 'id': '231a0987-938f-5973-bbbd-3b8d3ff0c386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB76266',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit Courier',
 'odometer': 181542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Courier 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2021}
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB76266%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Saving data for SB76266: {'auction_closing_time': 1765039200.0, 'created_time': 1762880598.454408, 'last_price_update_time': 1764954392.003549}
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB76266') HTTP/1.1" 204 0
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: VZ11773
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ11773%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for VZ11773: 2
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_d1e9dd4377b43c0a06e2a9285bf2573a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_d1e9dd4377b43c0a06e2a9285bf2573a.jpg not downloaded yet
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: DL02134
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL02134%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for DL02134: 1
2025-12-05 17:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 with identifier: RX68125
2025-12-05 17:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 with scrape type 2
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 with scrape type 2
2025-12-05 17:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83cc15a1-bc7d-5d40-a9d8-2add3acb2616, identifier: RX68125
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_39cb803b2fd1083dab7ed8cfd1b228c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_39cb803b2fd1083dab7ed8cfd1b228c4.jpg not downloaded yet
2025-12-05 17:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 with identifier: RX68125
2025-12-05 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 with identifier: RX68125
2025-12-05 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 spider: auto1.es
2025-12-05 17:06:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 83cc15a1-bc7d-5d40-a9d8-2add3acb2616 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:51:11Z',
 'fuel_type': 'diesel',
 'id': '83cc15a1-bc7d-5d40-a9d8-2add3acb2616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX68125',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 49306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2023}
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX68125%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Saving data for RX68125: {'auction_closing_time': 1765039871.0, 'created_time': 1761584543.981483, 'last_price_update_time': 1764954392.397736}
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX68125') HTTP/1.1" 204 0
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: PE00244
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE00244%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for PE00244: 2
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG40142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_4d0b0c7a84d80ced46a0b0f6833558ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4d0b0c7a84d80ced46a0b0f6833558ff.jpg not downloaded yet
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: PH08907
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH08907%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for PH08907: 1
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD33656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_6fb84eee4de8c5e7065c93a697afc664.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6fb84eee4de8c5e7065c93a697afc664.jpg not downloaded yet
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: NR98659
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR98659%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for NR98659: 1
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_b2f6d9cef6300268eb38522ab21ca538.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b2f6d9cef6300268eb38522ab21ca538.jpg not downloaded yet
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: VB84125
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB84125%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for VB84125: 1
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ98968> (referer: https://www.auto1.com/v1/car-details-view/SJ98968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_e0d9f550d1518b9ba7518d2f823c6d1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_e0d9f550d1518b9ba7518d2f823c6d1e.jpg not downloaded yet
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: PV61138
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV61138%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for PV61138: 2
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_6087f73e91f5c9ad2ec876739e630924.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6087f73e91f5c9ad2ec876739e630924.jpg not downloaded yet
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: UF45517
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF45517%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for UF45517: 2
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_4c64af48c12ceca5972cf20de0764b20.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4c64af48c12ceca5972cf20de0764b20.jpg not downloaded yet
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ00657> (referer: https://www.auto1.com/v1/car-details-view/AJ00657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ73494> (referer: https://www.auto1.com/v1/car-details-view/LZ73494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: PY30936
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY30936%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for PY30936: 2
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_0ea58f32d91249fb036b5f942447173a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_0ea58f32d91249fb036b5f942447173a.jpg not downloaded yet
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: FS23798
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS23798%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for FS23798: 2
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_39cb803b2fd1083dab7ed8cfd1b228c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_8149fa7945059e7922bcbb51c6c20433.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_8149fa7945059e7922bcbb51c6c20433.jpg not downloaded yet
2025-12-05 17:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e87155f7-1051-59df-b4c2-3dde100a3f96 with identifier: SJ98968
2025-12-05 17:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87155f7-1051-59df-b4c2-3dde100a3f96 with scrape type 2
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e87155f7-1051-59df-b4c2-3dde100a3f96 with scrape type 2
2025-12-05 17:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e87155f7-1051-59df-b4c2-3dde100a3f96, identifier: SJ98968
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4d0b0c7a84d80ced46a0b0f6833558ff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [auto1.es] INFO: Found listing with ID: FU81422
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU81422%27 HTTP/1.1" 200 None
2025-12-05 17:06:32 [auto1.es] INFO: Scrape type for FU81422: 2
2025-12-05 17:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e87155f7-1051-59df-b4c2-3dde100a3f96 with identifier: SJ98968
2025-12-05 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e87155f7-1051-59df-b4c2-3dde100a3f96 with identifier: SJ98968
2025-12-05 17:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e87155f7-1051-59df-b4c2-3dde100a3f96 with identifier: SJ98968 to the API
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ98968>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:50:01Z',
 'fuel_type': 'hybrid',
 'id': 'e87155f7-1051-59df-b4c2-3dde100a3f96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ98968',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 66707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ98968%27 HTTP/1.1" 200 None
2025-12-05 17:06:33 [auto1.es] INFO: Saving data for SJ98968: {'auction_closing_time': 1765039801.0, 'created_time': 1763658169.036684, 'last_price_update_time': 1764954393.194534}
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SJ98968') HTTP/1.1" 204 0
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_16cf61652a08f69b779ff4c8d84007b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_16cf61652a08f69b779ff4c8d84007b7.jpg not downloaded yet
2025-12-05 17:06:33 [auto1.es] INFO: Found listing with ID: CC84729
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC84729%27 HTTP/1.1" 200 None
2025-12-05 17:06:33 [auto1.es] INFO: Scrape type for CC84729: 2
2025-12-05 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e69563-5ed5-506c-bacd-3d5fea02630f with identifier: AJ00657
2025-12-05 17:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e69563-5ed5-506c-bacd-3d5fea02630f with scrape type 2
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e69563-5ed5-506c-bacd-3d5fea02630f with scrape type 2
2025-12-05 17:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a3e69563-5ed5-506c-bacd-3d5fea02630f, identifier: AJ00657
2025-12-05 17:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 with identifier: LZ73494
2025-12-05 17:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 with scrape type 2
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 with scrape type 2
2025-12-05 17:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ab26661c-ec8a-5965-9b2c-087ac4b8a2e0, identifier: LZ73494
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbde0d0>
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_39cb803b2fd1083dab7ed8cfd1b228c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_39cb803b2fd1083dab7ed8cfd1b228c4.jpg saved to cache
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_b044f57db3ec677af872f517278f4c2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b044f57db3ec677af872f517278f4c2e.jpg not downloaded yet
2025-12-05 17:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ90079> (referer: https://www.auto1.com/v1/car-details-view/XZ90079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a3e69563-5ed5-506c-bacd-3d5fea02630f with identifier: AJ00657
2025-12-05 17:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a3e69563-5ed5-506c-bacd-3d5fea02630f with identifier: AJ00657
2025-12-05 17:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a3e69563-5ed5-506c-bacd-3d5fea02630f with identifier: AJ00657 to the API
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ00657>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:25:10Z',
 'fuel_type': 'diesel',
 'id': 'a3e69563-5ed5-506c-bacd-3d5fea02630f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ00657',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 64644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2022}
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ00657%27 HTTP/1.1" 200 None
2025-12-05 17:06:34 [auto1.es] INFO: Saving data for AJ00657: {'auction_closing_time': 1765038310.0, 'created_time': 1762880495.495984, 'last_price_update_time': 1764954394.190705}
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ00657') HTTP/1.1" 204 0
2025-12-05 17:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 with identifier: LZ73494
2025-12-05 17:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 with identifier: LZ73494
2025-12-05 17:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2025-12-05 17:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 spider: auto1.es
2025-12-05 17:06:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ab26661c-ec8a-5965-9b2c-087ac4b8a2e0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:13:29Z',
 'fuel_type': 'diesel',
 'id': 'ab26661c-ec8a-5965-9b2c-087ac4b8a2e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ73494',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 89970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ73494%27 HTTP/1.1" 200 None
2025-12-05 17:06:34 [auto1.es] INFO: Saving data for LZ73494: {'auction_closing_time': 1765037609.0, 'created_time': 1763053374.907318, 'last_price_update_time': 1764954394.404451}
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ73494') HTTP/1.1" 204 0
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_0ea58f32d91249fb036b5f942447173a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:34 [auto1.es] INFO: Found listing with ID: UG34267
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG34267%27 HTTP/1.1" 200 None
2025-12-05 17:06:34 [auto1.es] INFO: Scrape type for UG34267: 2
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da43f50>
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_4d0b0c7a84d80ced46a0b0f6833558ff.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4d0b0c7a84d80ced46a0b0f6833558ff.jpg saved to cache
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS77916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE49879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB40361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:34 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:06:34 [auto1.es] INFO: Found listing with ID: GU53560
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU53560%27 HTTP/1.1" 200 None
2025-12-05 17:06:34 [auto1.es] INFO: Scrape type for GU53560: 2
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [auto1.es] INFO: Found listing with ID: PR65471
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR65471%27 HTTP/1.1" 200 None
2025-12-05 17:06:34 [auto1.es] INFO: Scrape type for PR65471: 1
2025-12-05 17:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff42fd3-a60b-5cb6-b58b-e57a82c15268 with identifier: XZ90079
2025-12-05 17:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff42fd3-a60b-5cb6-b58b-e57a82c15268 with scrape type 2
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aff42fd3-a60b-5cb6-b58b-e57a82c15268 with scrape type 2
2025-12-05 17:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aff42fd3-a60b-5cb6-b58b-e57a82c15268, identifier: XZ90079
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e656f10>
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_0ea58f32d91249fb036b5f942447173a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_0ea58f32d91249fb036b5f942447173a.jpg saved to cache
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: VY06028
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY06028%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for VY06028: 2
2025-12-05 17:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aff42fd3-a60b-5cb6-b58b-e57a82c15268 with identifier: XZ90079
2025-12-05 17:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aff42fd3-a60b-5cb6-b58b-e57a82c15268 with identifier: XZ90079
2025-12-05 17:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: aff42fd3-a60b-5cb6-b58b-e57a82c15268 spider: auto1.es
2025-12-05 17:06:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: aff42fd3-a60b-5cb6-b58b-e57a82c15268 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:28:26Z',
 'fuel_type': 'diesel',
 'id': 'aff42fd3-a60b-5cb6-b58b-e57a82c15268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ90079',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 89251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2021}
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ90079%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Saving data for XZ90079: {'auction_closing_time': 1765038506.0, 'created_time': 1761043202.953356, 'last_price_update_time': 1764954395.362239}
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ90079') HTTP/1.1" 204 0
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: XJ09621
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ09621%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for XJ09621: 1
2025-12-05 17:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_16cf61652a08f69b779ff4c8d84007b7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: CT67329
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT67329%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for CT67329: 2
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: AH84228
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH84228%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for AH84228: 1
2025-12-05 17:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF09128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: ZY64818
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY64818%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for ZY64818: 2
2025-12-05 17:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: LK10680
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK10680%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for LK10680: 1
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: CM18367
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM18367%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for CM18367: 2
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: SC87241
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC87241%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for SC87241: 1
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: YU54823
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU54823%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for YU54823: 1
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: ND76145
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND76145%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for ND76145: 1
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e56ae50>
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_16cf61652a08f69b779ff4c8d84007b7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_16cf61652a08f69b779ff4c8d84007b7.jpg saved to cache
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: LP90075
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP90075%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for LP90075: 2
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: DE51179
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51179%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for DE51179: 1
2025-12-05 17:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b044f57db3ec677af872f517278f4c2e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: VD57608
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD57608%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for VD57608: 1
2025-12-05 17:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT53511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC96824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: SU76295
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU76295%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for SU76295: 1
2025-12-05 17:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: AA62489
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA62489%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for AA62489: 1
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: PS87786
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS87786%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for PS87786: 1
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: PR65471
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: GX42113
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX42113%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for GX42113: 1
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: KM01709
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM01709%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for KM01709: 2
2025-12-05 17:06:35 [auto1.es] INFO: Found listing with ID: XZ62505
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62505%27 HTTP/1.1" 200 None
2025-12-05 17:06:35 [auto1.es] INFO: Scrape type for XZ62505: 1
2025-12-05 17:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6da90>
2025-12-05 17:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_b044f57db3ec677af872f517278f4c2e.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b044f57db3ec677af872f517278f4c2e.jpg saved to cache
2025-12-05 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX91354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: NW34811
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW34811%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for NW34811: 1
2025-12-05 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: YS55107
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS55107%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for YS55107: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: BJ27359
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ27359%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for BJ27359: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: FV98550
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for FV98550: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: SX34380
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX34380%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for SX34380: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: TR27399
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR27399%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for TR27399: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: MY78035
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY78035%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for MY78035: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: PA07694
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA07694%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for PA07694: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: KY26160
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY26160%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for KY26160: 2
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: XZ85086
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ85086%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for XZ85086: 2
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: WX30303
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX30303%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for WX30303: 1
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: FX22323
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX22323%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for FX22323: 2
2025-12-05 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB84125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: GF73263
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF73263%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for GF73263: 1
2025-12-05 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: RZ25182
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ25182%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for RZ25182: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: MK33425
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK33425%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for MK33425: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: AM88870
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM88870%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for AM88870: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: FM29540
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM29540%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for FM29540: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: BU63416
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU63416%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for BU63416: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: HZ39709
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ39709%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for HZ39709: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: NS55981
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS55981%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for NS55981: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: FC42735
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC42735%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for FC42735: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: DZ43348
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ43348%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for DZ43348: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: YK06746
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK06746%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for YK06746: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: HP55486
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP55486%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for HP55486: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: XV82980
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV82980%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for XV82980: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: RF22749
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF22749%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for RF22749: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: WF77880
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF77880%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for WF77880: 0
2025-12-05 17:06:36 [auto1.es] INFO: Found listing with ID: PT82060
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT82060%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.es] INFO: Scrape type for PT82060: 0
2025-12-05 17:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC84729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM47502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD33656> (referer: https://www.auto1.com/v1/car-details-view/DD33656/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31271da-ef11-50fc-99a3-15cb22f3a3df with identifier: DD33656
2025-12-05 17:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31271da-ef11-50fc-99a3-15cb22f3a3df with scrape type 2
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b31271da-ef11-50fc-99a3-15cb22f3a3df with scrape type 2
2025-12-05 17:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b31271da-ef11-50fc-99a3-15cb22f3a3df, identifier: DD33656
2025-12-05 17:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b31271da-ef11-50fc-99a3-15cb22f3a3df with identifier: DD33656
2025-12-05 17:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b31271da-ef11-50fc-99a3-15cb22f3a3df with identifier: DD33656
2025-12-05 17:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b31271da-ef11-50fc-99a3-15cb22f3a3df spider: auto1.es
2025-12-05 17:06:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b31271da-ef11-50fc-99a3-15cb22f3a3df due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:06:23Z',
 'fuel_type': 'diesel',
 'id': 'b31271da-ef11-50fc-99a3-15cb22f3a3df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD33656',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 131923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD33656%27 HTTP/1.1" 200 None
2025-12-05 17:06:38 [auto1.es] INFO: Saving data for DD33656: {'auction_closing_time': 1765037183.0, 'created_time': 1760004091.856083, 'last_price_update_time': 1764954398.711164}
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD33656') HTTP/1.1" 204 0
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG34267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY06028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:38 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:06:38 [auto1.es] INFO: Found listing with ID: MT55786
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT55786%27 HTTP/1.1" 200 None
2025-12-05 17:06:38 [auto1.es] INFO: Scrape type for MT55786: 0
2025-12-05 17:06:38 [auto1.es] INFO: Found listing with ID: YB39664
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB39664%27 HTTP/1.1" 200 None
2025-12-05 17:06:38 [auto1.es] INFO: Scrape type for YB39664: 2
2025-12-05 17:06:38 [auto1.es] INFO: Found listing with ID: KV05449
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV05449%27 HTTP/1.1" 200 None
2025-12-05 17:06:38 [auto1.es] INFO: Scrape type for KV05449: 0
2025-12-05 17:06:38 [auto1.es] INFO: Found listing with ID: EP14303
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP14303%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for EP14303: 2
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: HV71033
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV71033%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for HV71033: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: BE67955
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE67955%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for BE67955: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: KF48149
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF48149%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for KF48149: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: MD10207
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD10207%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for MD10207: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: TF79942
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF79942%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for TF79942: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: LT57952
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LT57952%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for LT57952: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: WU13784
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13784%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for WU13784: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: PW14206
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW14206%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for PW14206: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: KU77979
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU77979%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for KU77979: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: WE24971
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE24971%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for WE24971: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: WZ10616
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ10616%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for WZ10616: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: KV28204
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV28204%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for KV28204: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: MN19248
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN19248%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for MN19248: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: RR49185
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR49185%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for RR49185: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: AP49041
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP49041%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for AP49041: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: DE63944
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE63944%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for DE63944: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: SF27235
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF27235%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for SF27235: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: MY15790
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY15790%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for MY15790: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: RY84383
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY84383%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for RY84383: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: CJ14003
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ14003%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for CJ14003: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: LE89720
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE89720%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for LE89720: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: FS52760
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS52760%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for FS52760: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: SL34595
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL34595%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for SL34595: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: HZ41360
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ41360%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for HZ41360: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: BR93744
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR93744%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for BR93744: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: VR56012
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR56012%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for VR56012: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: FA78323
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA78323%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for FA78323: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: BH56009
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH56009%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for BH56009: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: AM21528
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM21528%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for AM21528: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: AZ27260
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ27260%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for AZ27260: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: TD45873
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD45873%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for TD45873: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: HP28608
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP28608%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for HP28608: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: LA05739
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA05739%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for LA05739: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: VE41546
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE41546%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for VE41546: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: RZ03987
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ03987%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for RZ03987: 0
2025-12-05 17:06:39 [auto1.es] INFO: Found listing with ID: FJ60130
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ60130%27 HTTP/1.1" 200 None
2025-12-05 17:06:39 [auto1.es] INFO: Scrape type for FJ60130: 0
2025-12-05 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB40361> (referer: https://www.auto1.com/v1/car-details-view/TB40361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58fa910b-24aa-52a8-afbc-1f8b184e39f4 with identifier: TB40361
2025-12-05 17:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58fa910b-24aa-52a8-afbc-1f8b184e39f4 with scrape type 2
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58fa910b-24aa-52a8-afbc-1f8b184e39f4 with scrape type 2
2025-12-05 17:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58fa910b-24aa-52a8-afbc-1f8b184e39f4, identifier: TB40361
2025-12-05 17:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58fa910b-24aa-52a8-afbc-1f8b184e39f4 with identifier: TB40361
2025-12-05 17:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58fa910b-24aa-52a8-afbc-1f8b184e39f4 with identifier: TB40361
2025-12-05 17:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58fa910b-24aa-52a8-afbc-1f8b184e39f4 with identifier: TB40361 to the API
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB40361>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:18:42Z',
 'fuel_type': 'diesel',
 'id': '58fa910b-24aa-52a8-afbc-1f8b184e39f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB40361',
 'listing': 'auction',
 'location': 'ES',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 136551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.5 Blue-HDi Montmartre',
 'transmission': 'manual',
 'trim': 'Montmartre',
 'year': 2022}
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB40361%27 HTTP/1.1" 200 None
2025-12-05 17:06:40 [auto1.es] INFO: Saving data for TB40361: {'auction_closing_time': 1765037922.0, 'created_time': 1764176534.396095, 'last_price_update_time': 1764954400.446667}
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB40361') HTTP/1.1" 204 0
2025-12-05 17:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP90075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS23798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD57608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU81422/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF45517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET16826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC84729> (referer: https://www.auto1.com/v1/car-details-view/CC84729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7fb931-abe4-5366-ae7d-dfccddf32430 with identifier: CC84729
2025-12-05 17:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7fb931-abe4-5366-ae7d-dfccddf32430 with scrape type 2
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7fb931-abe4-5366-ae7d-dfccddf32430 with scrape type 2
2025-12-05 17:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c7fb931-abe4-5366-ae7d-dfccddf32430, identifier: CC84729
2025-12-05 17:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c7fb931-abe4-5366-ae7d-dfccddf32430 with identifier: CC84729
2025-12-05 17:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c7fb931-abe4-5366-ae7d-dfccddf32430 with identifier: CC84729
2025-12-05 17:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c7fb931-abe4-5366-ae7d-dfccddf32430 with identifier: CC84729 to the API
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC84729>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:23:09Z',
 'fuel_type': 'petrol',
 'id': '8c7fb931-abe4-5366-ae7d-dfccddf32430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC84729',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 121878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC84729%27 HTTP/1.1" 200 None
2025-12-05 17:06:42 [auto1.es] INFO: Saving data for CC84729: {'auction_closing_time': 1765038189.0, 'created_time': 1764761811.584244, 'last_price_update_time': 1764954402.805623}
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CC84729') HTTP/1.1" 204 0
2025-12-05 17:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX30303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY06028> (referer: https://www.auto1.com/v1/car-details-view/VY06028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c814bd4-3020-5250-b556-f851c9e90f06 with identifier: VY06028
2025-12-05 17:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c814bd4-3020-5250-b556-f851c9e90f06 with scrape type 2
2025-12-05 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c814bd4-3020-5250-b556-f851c9e90f06 with scrape type 2
2025-12-05 17:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c814bd4-3020-5250-b556-f851c9e90f06, identifier: VY06028
2025-12-05 17:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c814bd4-3020-5250-b556-f851c9e90f06 with identifier: VY06028
2025-12-05 17:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c814bd4-3020-5250-b556-f851c9e90f06 with identifier: VY06028
2025-12-05 17:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3c814bd4-3020-5250-b556-f851c9e90f06 spider: auto1.es
2025-12-05 17:06:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3c814bd4-3020-5250-b556-f851c9e90f06 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:25:33Z',
 'fuel_type': 'diesel',
 'id': '3c814bd4-3020-5250-b556-f851c9e90f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY06028',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 90492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2025-12-05 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY06028%27 HTTP/1.1" 200 None
2025-12-05 17:06:48 [auto1.es] INFO: Saving data for VY06028: {'auction_closing_time': 1765038333.0, 'created_time': 1762448773.093332, 'last_price_update_time': 1764954408.742657}
2025-12-05 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY06028') HTTP/1.1" 204 0
2025-12-05 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB84125> (referer: https://www.auto1.com/v1/car-details-view/VB84125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d8a2e86-5364-5ae5-9cec-868065ce4320 with identifier: VB84125
2025-12-05 17:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8a2e86-5364-5ae5-9cec-868065ce4320 with scrape type 1
2025-12-05 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_46edd9ccec988edbcf9757b7e4dd7c6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_46edd9ccec988edbcf9757b7e4dd7c6d.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_79d09cd5dd27772464c87092b5e1551a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_79d09cd5dd27772464c87092b5e1551a.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_d88f68e5b04f4277e707318b9e57a1b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_d88f68e5b04f4277e707318b9e57a1b7.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_aea828c51db6e770df8f329ec817bdb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_aea828c51db6e770df8f329ec817bdb1.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_26706ede47f999055e0f84b57ec5eb84.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_26706ede47f999055e0f84b57ec5eb84.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_98dee48de58e0ea954b02062e51b7bef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_98dee48de58e0ea954b02062e51b7bef.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_04d309338fbc081cdfc6887986f38238.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_04d309338fbc081cdfc6887986f38238.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_24c7eb0fcde5cce3fb02388728aa318c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_24c7eb0fcde5cce3fb02388728aa318c.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_3b59f0a5b756b1b14af69d90b7190767.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_3b59f0a5b756b1b14af69d90b7190767.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_158375eb377c5e6b6640ac0a5fe59870.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_158375eb377c5e6b6640ac0a5fe59870.jpg not downloaded yet
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_19c226f1f4e10da0f00ab37eea676777.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_19c226f1f4e10da0f00ab37eea676777.jpg not downloaded yet
2025-12-05 17:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP14303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_19c226f1f4e10da0f00ab37eea676777.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db63210>
2025-12-05 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_19c226f1f4e10da0f00ab37eea676777.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_19c226f1f4e10da0f00ab37eea676777.jpg saved to cache
2025-12-05 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF09128> (referer: https://www.auto1.com/v1/car-details-view/TF09128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_158375eb377c5e6b6640ac0a5fe59870.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a4d4de0-58c8-5395-a994-7ade17b711fa with identifier: TF09128
2025-12-05 17:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a4d4de0-58c8-5395-a994-7ade17b711fa with scrape type 2
2025-12-05 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a4d4de0-58c8-5395-a994-7ade17b711fa with scrape type 2
2025-12-05 17:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a4d4de0-58c8-5395-a994-7ade17b711fa, identifier: TF09128
2025-12-05 17:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a4d4de0-58c8-5395-a994-7ade17b711fa with identifier: TF09128
2025-12-05 17:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a4d4de0-58c8-5395-a994-7ade17b711fa with identifier: TF09128
2025-12-05 17:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a4d4de0-58c8-5395-a994-7ade17b711fa with identifier: TF09128 to the API
2025-12-05 17:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF09128>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:36:50Z',
 'fuel_type': 'hybrid',
 'id': '8a4d4de0-58c8-5395-a994-7ade17b711fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF09128',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 89655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2022}
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF09128%27 HTTP/1.1" 200 None
2025-12-05 17:06:52 [auto1.es] INFO: Saving data for TF09128: {'auction_closing_time': 1765039010.0, 'created_time': 1764064950.333264, 'last_price_update_time': 1764954412.060144}
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF09128') HTTP/1.1" 204 0
2025-12-05 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_3b59f0a5b756b1b14af69d90b7190767.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6c490>
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_158375eb377c5e6b6640ac0a5fe59870.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_158375eb377c5e6b6640ac0a5fe59870.jpg saved to cache
2025-12-05 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_24c7eb0fcde5cce3fb02388728aa318c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d90d050>
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_3b59f0a5b756b1b14af69d90b7190767.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_3b59f0a5b756b1b14af69d90b7190767.jpg saved to cache
2025-12-05 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d862810>
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_24c7eb0fcde5cce3fb02388728aa318c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_24c7eb0fcde5cce3fb02388728aa318c.jpg saved to cache
2025-12-05 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_04d309338fbc081cdfc6887986f38238.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_98dee48de58e0ea954b02062e51b7bef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5cfc90>
2025-12-05 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_04d309338fbc081cdfc6887986f38238.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_04d309338fbc081cdfc6887986f38238.jpg saved to cache
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_26706ede47f999055e0f84b57ec5eb84.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e811010>
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_98dee48de58e0ea954b02062e51b7bef.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_98dee48de58e0ea954b02062e51b7bef.jpg saved to cache
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_aea828c51db6e770df8f329ec817bdb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db636d0>
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_26706ede47f999055e0f84b57ec5eb84.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_26706ede47f999055e0f84b57ec5eb84.jpg saved to cache
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_d88f68e5b04f4277e707318b9e57a1b7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a5b90>
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_aea828c51db6e770df8f329ec817bdb1.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_aea828c51db6e770df8f329ec817bdb1.jpg saved to cache
2025-12-05 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_79d09cd5dd27772464c87092b5e1551a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da993d0>
2025-12-05 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_d88f68e5b04f4277e707318b9e57a1b7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_d88f68e5b04f4277e707318b9e57a1b7.jpg saved to cache
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_46edd9ccec988edbcf9757b7e4dd7c6d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da35f50>
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_79d09cd5dd27772464c87092b5e1551a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_79d09cd5dd27772464c87092b5e1551a.jpg saved to cache
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74c290>
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_46edd9ccec988edbcf9757b7e4dd7c6d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_46edd9ccec988edbcf9757b7e4dd7c6d.jpg saved to cache
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db77f50>
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff8%252F35f8d68152fc5a97477830c11077984f%252Fpa%252FVB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg saved to cache
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d8a2e86-5364-5ae5-9cec-868065ce4320
2025-12-05 17:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d8a2e86-5364-5ae5-9cec-868065ce4320, skipping ID generation
2025-12-05 17:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8a2e86-5364-5ae5-9cec-868065ce4320 with scrape type 1
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4d8a2e86-5364-5ae5-9cec-868065ce4320 from tracking dictionaries
2025-12-05 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d8a2e86-5364-5ae5-9cec-868065ce4320 sending to next pipeline
2025-12-05 17:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d8a2e86-5364-5ae5-9cec-868065ce4320, identifier: VB84125
2025-12-05 17:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d8a2e86-5364-5ae5-9cec-868065ce4320 with identifier: VB84125
2025-12-05 17:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d8a2e86-5364-5ae5-9cec-868065ce4320 with identifier: VB84125
2025-12-05 17:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d8a2e86-5364-5ae5-9cec-868065ce4320 with identifier: VB84125 to the API
2025-12-05 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 455,
 'expiration_date': '2025-12-06T16:11:30Z',
 'fuel_type': 'hybrid',
 'id': '4d8a2e86-5364-5ae5-9cec-868065ce4320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB84125',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 55351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40883,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_7ccf7c301e36c6f0655ff6c6557de72b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40883,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_46edd9ccec988edbcf9757b7e4dd7c6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35352,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_79d09cd5dd27772464c87092b5e1551a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35352,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_d88f68e5b04f4277e707318b9e57a1b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41008,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_aea828c51db6e770df8f329ec817bdb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41008,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_26706ede47f999055e0f84b57ec5eb84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37948,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_98dee48de58e0ea954b02062e51b7bef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37948,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_04d309338fbc081cdfc6887986f38238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54355,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_24c7eb0fcde5cce3fb02388728aa318c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54355,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_3b59f0a5b756b1b14af69d90b7190767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56372,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_158375eb377c5e6b6640ac0a5fe59870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8a2e86-5364-5ae5-9cec-868065ce4320/4d8a2e86-5364-5ae5-9cec-868065ce4320_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55485,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f8/35f8d68152fc5a97477830c11077984f/pa/VB84125_19c226f1f4e10da0f00ab37eea676777.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Recharge Plug-in Hybrid Core AWD',
 'transmission': 'automatic',
 'trim': 'Core AWD',
 'year': 2024}
2025-12-05 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB84125%27 HTTP/1.1" 200 None
2025-12-05 17:06:55 [auto1.es] INFO: Saving data for VB84125: {'created_time': 1764954415.357747, 'last_price_update_time': 1764954415.357756, 'auction_closing_time': 1765037490.0}
2025-12-05 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB84125') HTTP/1.1" 204 0
2025-12-05 17:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG34267> (referer: https://www.auto1.com/v1/car-details-view/UG34267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX22323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca55f09-7543-51a2-b6cd-d12de8c8d2f5 with identifier: UG34267
2025-12-05 17:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca55f09-7543-51a2-b6cd-d12de8c8d2f5 with scrape type 2
2025-12-05 17:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca55f09-7543-51a2-b6cd-d12de8c8d2f5 with scrape type 2
2025-12-05 17:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fca55f09-7543-51a2-b6cd-d12de8c8d2f5, identifier: UG34267
2025-12-05 17:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fca55f09-7543-51a2-b6cd-d12de8c8d2f5 with identifier: UG34267
2025-12-05 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fca55f09-7543-51a2-b6cd-d12de8c8d2f5 with identifier: UG34267
2025-12-05 17:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fca55f09-7543-51a2-b6cd-d12de8c8d2f5 with identifier: UG34267 to the API
2025-12-05 17:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG34267>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:44:02Z',
 'fuel_type': 'diesel',
 'id': 'fca55f09-7543-51a2-b6cd-d12de8c8d2f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG34267',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 56038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2025-12-05 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG34267%27 HTTP/1.1" 200 None
2025-12-05 17:06:57 [auto1.es] INFO: Saving data for UG34267: {'auction_closing_time': 1765039442.0, 'created_time': 1764090338.242887, 'last_price_update_time': 1764954417.588472}
2025-12-05 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG34267') HTTP/1.1" 204 0
2025-12-05 17:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF45517> (referer: https://www.auto1.com/v1/car-details-view/UF45517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d684ec70-5f62-591f-9bef-d1e7d24638fa with identifier: UF45517
2025-12-05 17:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d684ec70-5f62-591f-9bef-d1e7d24638fa with scrape type 2
2025-12-05 17:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d684ec70-5f62-591f-9bef-d1e7d24638fa with scrape type 2
2025-12-05 17:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d684ec70-5f62-591f-9bef-d1e7d24638fa, identifier: UF45517
2025-12-05 17:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d684ec70-5f62-591f-9bef-d1e7d24638fa with identifier: UF45517
2025-12-05 17:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d684ec70-5f62-591f-9bef-d1e7d24638fa with identifier: UF45517
2025-12-05 17:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d684ec70-5f62-591f-9bef-d1e7d24638fa spider: auto1.es
2025-12-05 17:06:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d684ec70-5f62-591f-9bef-d1e7d24638fa due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:40:47Z',
 'fuel_type': 'diesel',
 'id': 'd684ec70-5f62-591f-9bef-d1e7d24638fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF45517',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 96930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2020}
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF45517%27 HTTP/1.1" 200 None
2025-12-05 17:06:58 [auto1.es] INFO: Saving data for UF45517: {'auction_closing_time': 1765039247.0, 'created_time': 1763571973.229667, 'last_price_update_time': 1764954418.673334}
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF45517') HTTP/1.1" 204 0
2025-12-05 17:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU81422> (referer: https://www.auto1.com/v1/car-details-view/FU81422/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM47502> (referer: https://www.auto1.com/v1/car-details-view/MM47502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238c7431-d83c-590a-bfa0-bd5b3825b3b7 with identifier: FU81422
2025-12-05 17:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238c7431-d83c-590a-bfa0-bd5b3825b3b7 with scrape type 2
2025-12-05 17:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 238c7431-d83c-590a-bfa0-bd5b3825b3b7 with scrape type 2
2025-12-05 17:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 238c7431-d83c-590a-bfa0-bd5b3825b3b7, identifier: FU81422
2025-12-05 17:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 238c7431-d83c-590a-bfa0-bd5b3825b3b7 with identifier: FU81422
2025-12-05 17:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 238c7431-d83c-590a-bfa0-bd5b3825b3b7 with identifier: FU81422
2025-12-05 17:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 238c7431-d83c-590a-bfa0-bd5b3825b3b7 with identifier: FU81422 to the API
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FU81422>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:37:22Z',
 'fuel_type': 'diesel',
 'id': '238c7431-d83c-590a-bfa0-bd5b3825b3b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU81422',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 75319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU81422%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [auto1.es] INFO: Saving data for FU81422: {'auction_closing_time': 1765039042.0, 'created_time': 1762535291.964283, 'last_price_update_time': 1764954419.181581}
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FU81422') HTTP/1.1" 204 0
2025-12-05 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92beff75-7821-5dce-a167-6c528dd8b179 with identifier: MM47502
2025-12-05 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92beff75-7821-5dce-a167-6c528dd8b179 with scrape type 1
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_5994a456777d1a2f84c5946eb156f91d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5994a456777d1a2f84c5946eb156f91d.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_9374b9887bb16c59f7c64c82c0e3a147.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_9374b9887bb16c59f7c64c82c0e3a147.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_67ca7d0821a2e6c3efb2cc3e7c74068e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_67ca7d0821a2e6c3efb2cc3e7c74068e.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_b3c0fe58b808bb05a6bf191f8d28bac9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_b3c0fe58b808bb05a6bf191f8d28bac9.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_e81436a628847c9de3c596f20a65e49d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_e81436a628847c9de3c596f20a65e49d.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_1753ae5ecb68b314b74276833a3614e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_1753ae5ecb68b314b74276833a3614e5.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_d4897202ff3f342a5b7aba784adf7769.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_d4897202ff3f342a5b7aba784adf7769.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_5637554d650910033413c31f73c8f1c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5637554d650910033413c31f73c8f1c8.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_f216cf7cd51cdd2cddffcd6c9434f491.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f216cf7cd51cdd2cddffcd6c9434f491.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_f05b1819c4ec4001198c9bef0760fd4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f05b1819c4ec4001198c9bef0760fd4c.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_756bfc8b1aede6b4ea1a27070968d449.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_756bfc8b1aede6b4ea1a27070968d449.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_3c6104c476355d7867ea06af2125cdce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_3c6104c476355d7867ea06af2125cdce.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_cf7d035ef5b6a136fc3758cdcf7ea3c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_cf7d035ef5b6a136fc3758cdcf7ea3c4.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_5b9a307e53e95b8f2458122cd0eba7b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5b9a307e53e95b8f2458122cd0eba7b0.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_292aa65b98871b144c24cdb8739747d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_292aa65b98871b144c24cdb8739747d2.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_2a2fa11f0926123bc9686eb1c99a0e09.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_2a2fa11f0926123bc9686eb1c99a0e09.jpg not downloaded yet
2025-12-05 17:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX30303> (referer: https://www.auto1.com/v1/car-details-view/WX30303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281587f7-cbcd-5e89-8201-60dd4650bb58 with identifier: WX30303
2025-12-05 17:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281587f7-cbcd-5e89-8201-60dd4650bb58 with scrape type 1
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_7c6961cda7e9612ffaaf197125329cb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_7c6961cda7e9612ffaaf197125329cb1.jpg not downloaded yet
2025-12-05 17:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_2a2fa11f0926123bc9686eb1c99a0e09.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_d90195d13eb3c317cdddeed2640ec777.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d90195d13eb3c317cdddeed2640ec777.jpg not downloaded yet
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_29e8ff837d0777887ce092efaf17ef98.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_29e8ff837d0777887ce092efaf17ef98.jpg not downloaded yet
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_9c56b4ffa32017331ac1687347758202.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_9c56b4ffa32017331ac1687347758202.jpg not downloaded yet
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_ef5a400ced0570699a82029a074906a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ef5a400ced0570699a82029a074906a0.jpg not downloaded yet
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_d86a541f631426036bcb736572748829.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d86a541f631426036bcb736572748829.jpg not downloaded yet
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_3f60ad48b1d34fd98ecec147ba2f209e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_3f60ad48b1d34fd98ecec147ba2f209e.jpg not downloaded yet
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_70c37b9a1d975ba7f91d242231d10891.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_70c37b9a1d975ba7f91d242231d10891.jpg not downloaded yet
2025-12-05 17:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_7c6961cda7e9612ffaaf197125329cb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_c7d28e91cf0e4b83af1f28e59d7268d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_c7d28e91cf0e4b83af1f28e59d7268d9.jpg not downloaded yet
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_ad7fd58a222b66e34496d1b570576a4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ad7fd58a222b66e34496d1b570576a4a.jpg not downloaded yet
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d859dd0>
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_2a2fa11f0926123bc9686eb1c99a0e09.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_2a2fa11f0926123bc9686eb1c99a0e09.jpg saved to cache
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_45b4f10135e728c81af543a737942686.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_45b4f10135e728c81af543a737942686.jpg not downloaded yet
2025-12-05 17:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_3f60ad48b1d34fd98ecec147ba2f209e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_b9e71ee9ac44fc33616a50062e6a829d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_b9e71ee9ac44fc33616a50062e6a829d.jpg not downloaded yet
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4e99d0>
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_7c6961cda7e9612ffaaf197125329cb1.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_7c6961cda7e9612ffaaf197125329cb1.jpg saved to cache
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_e5e3ca490c542a6b598562264812024e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_e5e3ca490c542a6b598562264812024e.jpg not downloaded yet
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_80d883fffb72df14e26df1beec8eeeab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_80d883fffb72df14e26df1beec8eeeab.jpg not downloaded yet
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d904dd0>
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_3f60ad48b1d34fd98ecec147ba2f209e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_3f60ad48b1d34fd98ecec147ba2f209e.jpg saved to cache
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_0e74f2889c7f43f9cbc2f31296b910b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_0e74f2889c7f43f9cbc2f31296b910b3.jpg not downloaded yet
2025-12-05 17:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ad7fd58a222b66e34496d1b570576a4a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_832b1066591f5a129ffe2a9aaad7e118.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_832b1066591f5a129ffe2a9aaad7e118.jpg not downloaded yet
2025-12-05 17:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS23798> (referer: https://www.auto1.com/v1/car-details-view/FS23798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8eaa90>
2025-12-05 17:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_ad7fd58a222b66e34496d1b570576a4a.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ad7fd58a222b66e34496d1b570576a4a.jpg saved to cache
2025-12-05 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_80d883fffb72df14e26df1beec8eeeab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c31b61cc-7f32-5478-a94e-0900f30f428f with identifier: FS23798
2025-12-05 17:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c31b61cc-7f32-5478-a94e-0900f30f428f with scrape type 2
2025-12-05 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c31b61cc-7f32-5478-a94e-0900f30f428f with scrape type 2
2025-12-05 17:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c31b61cc-7f32-5478-a94e-0900f30f428f, identifier: FS23798
2025-12-05 17:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c31b61cc-7f32-5478-a94e-0900f30f428f with identifier: FS23798
2025-12-05 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c31b61cc-7f32-5478-a94e-0900f30f428f with identifier: FS23798
2025-12-05 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c31b61cc-7f32-5478-a94e-0900f30f428f spider: auto1.es
2025-12-05 17:07:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c31b61cc-7f32-5478-a94e-0900f30f428f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:51:21Z',
 'fuel_type': 'diesel',
 'id': 'c31b61cc-7f32-5478-a94e-0900f30f428f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS23798',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 93956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2021}
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS23798%27 HTTP/1.1" 200 None
2025-12-05 17:07:02 [auto1.es] INFO: Saving data for FS23798: {'auction_closing_time': 1765039881.0, 'created_time': 1764003813.619086, 'last_price_update_time': 1764954422.438172}
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FS23798') HTTP/1.1" 204 0
2025-12-05 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_0e74f2889c7f43f9cbc2f31296b910b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f25d0>
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_80d883fffb72df14e26df1beec8eeeab.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_80d883fffb72df14e26df1beec8eeeab.jpg saved to cache
2025-12-05 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_832b1066591f5a129ffe2a9aaad7e118.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba1250>
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_0e74f2889c7f43f9cbc2f31296b910b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_0e74f2889c7f43f9cbc2f31296b910b3.jpg saved to cache
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_e5e3ca490c542a6b598562264812024e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d863410>
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_832b1066591f5a129ffe2a9aaad7e118.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_832b1066591f5a129ffe2a9aaad7e118.jpg saved to cache
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_b9e71ee9ac44fc33616a50062e6a829d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d85ca10>
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_e5e3ca490c542a6b598562264812024e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_e5e3ca490c542a6b598562264812024e.jpg saved to cache
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_45b4f10135e728c81af543a737942686.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061ac90>
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_b9e71ee9ac44fc33616a50062e6a829d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_b9e71ee9ac44fc33616a50062e6a829d.jpg saved to cache
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_c7d28e91cf0e4b83af1f28e59d7268d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e57db50>
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_45b4f10135e728c81af543a737942686.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_45b4f10135e728c81af543a737942686.jpg saved to cache
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_70c37b9a1d975ba7f91d242231d10891.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD57608> (referer: https://www.auto1.com/v1/car-details-view/VD57608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d7dd0>
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_c7d28e91cf0e4b83af1f28e59d7268d9.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_c7d28e91cf0e4b83af1f28e59d7268d9.jpg saved to cache
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d86a541f631426036bcb736572748829.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8633d0>
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_70c37b9a1d975ba7f91d242231d10891.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_70c37b9a1d975ba7f91d242231d10891.jpg saved to cache
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 with identifier: VD57608
2025-12-05 17:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 with scrape type 1
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_92604d59e69e390b9bce25fcb5473c1c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg not downloaded yet
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg not downloaded yet
2025-12-05 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_9c56b4ffa32017331ac1687347758202.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e72a010>
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_d86a541f631426036bcb736572748829.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d86a541f631426036bcb736572748829.jpg saved to cache
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ef5a400ced0570699a82029a074906a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_268764070f99e29839389a2c39a3d0e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg not downloaded yet
2025-12-05 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_29e8ff837d0777887ce092efaf17ef98.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg not downloaded yet
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ea310>
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_9c56b4ffa32017331ac1687347758202.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_9c56b4ffa32017331ac1687347758202.jpg saved to cache
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_856f2da18792958b648c9e4b0ff49b32.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg not downloaded yet
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da08790>
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_ef5a400ced0570699a82029a074906a0.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ef5a400ced0570699a82029a074906a0.jpg saved to cache
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e2090>
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_29e8ff837d0777887ce092efaf17ef98.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_29e8ff837d0777887ce092efaf17ef98.jpg saved to cache
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_45f15b56ce9b287df3cec4ec268b1127.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg not downloaded yet
2025-12-05 17:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_5c829bede6d032673151f57ecb1f8524.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg not downloaded yet
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da70190>
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_92604d59e69e390b9bce25fcb5473c1c.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg saved to cache
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5cfdd0>
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg saved to cache
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg not downloaded yet
2025-12-05 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d90195d13eb3c317cdddeed2640ec777.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e789e50>
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_268764070f99e29839389a2c39a3d0e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg saved to cache
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg not downloaded yet
2025-12-05 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg not downloaded yet
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da73b10>
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg saved to cache
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c2950>
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145f1674599e9d3534ad3c06bef280c9%252Fpa%252FWX30303_d90195d13eb3c317cdddeed2640ec777.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d90195d13eb3c317cdddeed2640ec777.jpg saved to cache
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 281587f7-cbcd-5e89-8201-60dd4650bb58
2025-12-05 17:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 281587f7-cbcd-5e89-8201-60dd4650bb58, skipping ID generation
2025-12-05 17:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281587f7-cbcd-5e89-8201-60dd4650bb58 with scrape type 1
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 281587f7-cbcd-5e89-8201-60dd4650bb58 from tracking dictionaries
2025-12-05 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 281587f7-cbcd-5e89-8201-60dd4650bb58 sending to next pipeline
2025-12-05 17:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 281587f7-cbcd-5e89-8201-60dd4650bb58, identifier: WX30303
2025-12-05 17:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 281587f7-cbcd-5e89-8201-60dd4650bb58 with identifier: WX30303
2025-12-05 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 281587f7-cbcd-5e89-8201-60dd4650bb58 with identifier: WX30303
2025-12-05 17:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 281587f7-cbcd-5e89-8201-60dd4650bb58 with identifier: WX30303 to the API
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d90195d13eb3c317cdddeed2640ec777.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:20:48Z',
 'fuel_type': 'diesel',
 'id': '281587f7-cbcd-5e89-8201-60dd4650bb58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX30303',
 'listing': 'auction',
 'location': 'ES, Trasona',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 9505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_7c6961cda7e9612ffaaf197125329cb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d90195d13eb3c317cdddeed2640ec777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_29e8ff837d0777887ce092efaf17ef98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_9c56b4ffa32017331ac1687347758202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ef5a400ced0570699a82029a074906a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_d86a541f631426036bcb736572748829.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_3f60ad48b1d34fd98ecec147ba2f209e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_70c37b9a1d975ba7f91d242231d10891.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_c7d28e91cf0e4b83af1f28e59d7268d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_ad7fd58a222b66e34496d1b570576a4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_45b4f10135e728c81af543a737942686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_b9e71ee9ac44fc33616a50062e6a829d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_e5e3ca490c542a6b598562264812024e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_80d883fffb72df14e26df1beec8eeeab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_0e74f2889c7f43f9cbc2f31296b910b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_281587f7-cbcd-5e89-8201-60dd4650bb58/281587f7-cbcd-5e89-8201-60dd4650bb58_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145f1674599e9d3534ad3c06bef280c9/pa/WX30303_832b1066591f5a129ffe2a9aaad7e118.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX30303%27 HTTP/1.1" 200 None
2025-12-05 17:07:07 [auto1.es] INFO: Saving data for WX30303: {'created_time': 1764954427.752736, 'last_price_update_time': 1764954427.752748, 'auction_closing_time': 1765038048.0}
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WX30303') HTTP/1.1" 204 0
2025-12-05 17:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg not downloaded yet
2025-12-05 17:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9b5e10>
2025-12-05 17:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_45f15b56ce9b287df3cec4ec268b1127.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg saved to cache
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg not downloaded yet
2025-12-05 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_53b84573abd233508f2b7833c3b53c0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg not downloaded yet
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7560d0>
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_856f2da18792958b648c9e4b0ff49b32.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg saved to cache
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e825910>
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_5c829bede6d032673151f57ecb1f8524.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg saved to cache
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:08 [scrapy.extensions.logstats] INFO: Crawled 681 pages (at 92 pages/min), scraped 197 items (at 19 items/min)
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74e2d0>
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg saved to cache
2025-12-05 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690736fd0>
2025-12-05 17:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg saved to cache
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690734710>
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg saved to cache
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6d590>
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg saved to cache
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6d0d0>
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_53b84573abd233508f2b7833c3b53c0a.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg saved to cache
2025-12-05 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82eed0>
2025-12-05 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c8e16364b3d9a8039f9099fd931837%252Fpa%252FVD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg saved to cache
2025-12-05 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7
2025-12-05 17:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7, skipping ID generation
2025-12-05 17:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 with scrape type 1
2025-12-05 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 from tracking dictionaries
2025-12-05 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 sending to next pipeline
2025-12-05 17:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7, identifier: VD57608
2025-12-05 17:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 with identifier: VD57608
2025-12-05 17:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 with identifier: VD57608
2025-12-05 17:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 42776, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vd57608', 'expiration_date': '2025-12-06t16:13:39z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 2, 'c_o_2_emission_value': None, 'id': '0b7dfd85-fd85-504c-8d64-7475d43a9ca7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 25375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 25375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31025}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46594}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46594}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 42776}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2025-12-06t16:13:39z',
     'fuel_type': 'electro',
     'id': '0b7dfd85-fd85-504c-8d64-7475d43a9ca7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vd57608',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 42776,
     'odometer_in_km': 42776,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28427,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28427,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25375,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25375,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34736,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34736,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29026,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29549,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31025,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40831,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40831,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46594,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46594,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-12-15',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2025-12-05 17:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 spider: auto1.es
2025-12-05 17:07:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0b7dfd85-fd85-504c-8d64-7475d43a9ca7 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 42776, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vd57608', 'expiration_date': '2025-12-06t16:13:39z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 2, 'c_o_2_emission_value': None, 'id': '0b7dfd85-fd85-504c-8d64-7475d43a9ca7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 25375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 25375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31025}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46594}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46594}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 42776}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2025-12-06t16:13:39z',
     'fuel_type': 'electro',
     'id': '0b7dfd85-fd85-504c-8d64-7475d43a9ca7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vd57608',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 42776,
     'odometer_in_km': 42776,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28427,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28427,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25375,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25375,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34736,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34736,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29026,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29549,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31025,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40831,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40831,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46594,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46594,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-12-15',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:13:39Z',
 'fuel_type': 'electro',
 'id': '0b7dfd85-fd85-504c-8d64-7475d43a9ca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD57608',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 42776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28427,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_92604d59e69e390b9bce25fcb5473c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28427,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5244648ea0b2eaef0c5dc7642c9b838e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25375,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_268764070f99e29839389a2c39a3d0e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25375,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_9b35f37de87d9a8a5753312c3749fbb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34736,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_856f2da18792958b648c9e4b0ff49b32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34736,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_45f15b56ce9b287df3cec4ec268b1127.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29026,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5c829bede6d032673151f57ecb1f8524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29549,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_4d7c734f1b6a552ac0e9dbae8b720980.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31025,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_2326d88b4c14a91ec13c4f9824b43f12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40831,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f9cbc4bb9dc6cd3f60199cc20c8e7df3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40831,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_5aec9ef7a8f72dfbbc1895a69f2afef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46594,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_f2987e66a3af77e6c01c2e32b3ea722a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7dfd85-fd85-504c-8d64-7475d43a9ca7/0b7dfd85-fd85-504c-8d64-7475d43a9ca7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46594,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c8e16364b3d9a8039f9099fd931837/pa/VD57608_53b84573abd233508f2b7833c3b53c0a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD57608%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Saving data for VD57608: {'created_time': 1764954430.441398, 'last_price_update_time': 1764954430.441408, 'auction_closing_time': 1765037619.0}
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VD57608') HTTP/1.1" 204 0
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_292aa65b98871b144c24cdb8739747d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5b9a307e53e95b8f2458122cd0eba7b0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_cf7d035ef5b6a136fc3758cdcf7ea3c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: HP05914
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP05914%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for HP05914: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: KG16013
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG16013%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for KG16013: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: CR30169
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR30169%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for CR30169: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: AF25808
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF25808%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for AF25808: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: NR44611
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR44611%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for NR44611: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: YU15845
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU15845%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for YU15845: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: CJ66831
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ66831%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for CJ66831: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: XF02928
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF02928%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for XF02928: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: PL13054
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL13054%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for PL13054: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: SE18211
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE18211%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for SE18211: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: VF13033
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF13033%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for VF13033: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: JT04116
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT04116%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for JT04116: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: VR68816
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR68816%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for VR68816: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: LK27822
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK27822%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for LK27822: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: LF83583
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF83583%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for LF83583: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: WB97009
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB97009%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for WB97009: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: ZD97548
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD97548%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for ZD97548: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: YC07619
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC07619%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for YC07619: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: RM34315
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM34315%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for RM34315: 2
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f216cf7cd51cdd2cddffcd6c9434f491.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: ZJ46641
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ46641%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for ZJ46641: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: LD31996
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD31996%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for LD31996: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: YL63832
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL63832%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for YL63832: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: PT19275
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT19275%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for PT19275: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: LM37552
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM37552%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for LM37552: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: KF93087
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF93087%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for KF93087: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: CM46901
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM46901%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for CM46901: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: CT05796
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT05796%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for CT05796: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: YU85398
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU85398%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for YU85398: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: CX66077
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX66077%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for CX66077: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: RD75342
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD75342%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for RD75342: 2
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_3c6104c476355d7867ea06af2125cdce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f05b1819c4ec4001198c9bef0760fd4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_756bfc8b1aede6b4ea1a27070968d449.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: XY17013
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY17013%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for XY17013: 0
2025-12-05 17:07:10 [auto1.es] INFO: Found listing with ID: XB72676
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB72676%27 HTTP/1.1" 200 None
2025-12-05 17:07:10 [auto1.es] INFO: Scrape type for XB72676: 2
2025-12-05 17:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e60c190>
2025-12-05 17:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_292aa65b98871b144c24cdb8739747d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_292aa65b98871b144c24cdb8739747d2.jpg saved to cache
2025-12-05 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d932410>
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_5b9a307e53e95b8f2458122cd0eba7b0.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5b9a307e53e95b8f2458122cd0eba7b0.jpg saved to cache
2025-12-05 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e501310>
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_cf7d035ef5b6a136fc3758cdcf7ea3c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_cf7d035ef5b6a136fc3758cdcf7ea3c4.jpg saved to cache
2025-12-05 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:11 [auto1.es] INFO: Found listing with ID: AV58399
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV58399%27 HTTP/1.1" 200 None
2025-12-05 17:07:11 [auto1.es] INFO: Scrape type for AV58399: 0
2025-12-05 17:07:11 [auto1.es] INFO: Found listing with ID: YZ87219
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ87219%27 HTTP/1.1" 200 None
2025-12-05 17:07:11 [auto1.es] INFO: Scrape type for YZ87219: 0
2025-12-05 17:07:11 [auto1.es] INFO: Found listing with ID: HV64718
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV64718%27 HTTP/1.1" 200 None
2025-12-05 17:07:11 [auto1.es] INFO: Scrape type for HV64718: 0
2025-12-05 17:07:11 [auto1.es] INFO: Found listing with ID: KR08367
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR08367%27 HTTP/1.1" 200 None
2025-12-05 17:07:11 [auto1.es] INFO: Scrape type for KR08367: 0
2025-12-05 17:07:11 [auto1.es] INFO: Found listing with ID: XP19474
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP19474%27 HTTP/1.1" 200 None
2025-12-05 17:07:11 [auto1.es] INFO: Scrape type for XP19474: 0
2025-12-05 17:07:11 [auto1.es] INFO: Found listing with ID: BN01916
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN01916%27 HTTP/1.1" 200 None
2025-12-05 17:07:11 [auto1.es] INFO: Scrape type for BN01916: 0
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8e8cd0>
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_f216cf7cd51cdd2cddffcd6c9434f491.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f216cf7cd51cdd2cddffcd6c9434f491.jpg saved to cache
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe2e50>
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_3c6104c476355d7867ea06af2125cdce.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_3c6104c476355d7867ea06af2125cdce.jpg saved to cache
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e824e90>
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_f05b1819c4ec4001198c9bef0760fd4c.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f05b1819c4ec4001198c9bef0760fd4c.jpg saved to cache
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e574c10>
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_756bfc8b1aede6b4ea1a27070968d449.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_756bfc8b1aede6b4ea1a27070968d449.jpg saved to cache
2025-12-05 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5637554d650910033413c31f73c8f1c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9490d0>
2025-12-05 17:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_5637554d650910033413c31f73c8f1c8.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5637554d650910033413c31f73c8f1c8.jpg saved to cache
2025-12-05 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY26160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_d4897202ff3f342a5b7aba784adf7769.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97f590>
2025-12-05 17:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_d4897202ff3f342a5b7aba784adf7769.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_d4897202ff3f342a5b7aba784adf7769.jpg saved to cache
2025-12-05 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_1753ae5ecb68b314b74276833a3614e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97d610>
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_1753ae5ecb68b314b74276833a3614e5.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_1753ae5ecb68b314b74276833a3614e5.jpg saved to cache
2025-12-05 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX91354> (referer: https://www.auto1.com/v1/car-details-view/KX91354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_e81436a628847c9de3c596f20a65e49d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42e8c0a-1766-5869-b6b5-2278a04ee3da with identifier: KX91354
2025-12-05 17:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42e8c0a-1766-5869-b6b5-2278a04ee3da with scrape type 2
2025-12-05 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42e8c0a-1766-5869-b6b5-2278a04ee3da with scrape type 2
2025-12-05 17:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b42e8c0a-1766-5869-b6b5-2278a04ee3da, identifier: KX91354
2025-12-05 17:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b42e8c0a-1766-5869-b6b5-2278a04ee3da with identifier: KX91354
2025-12-05 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b42e8c0a-1766-5869-b6b5-2278a04ee3da with identifier: KX91354
2025-12-05 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b42e8c0a-1766-5869-b6b5-2278a04ee3da spider: auto1.es
2025-12-05 17:07:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b42e8c0a-1766-5869-b6b5-2278a04ee3da due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:03:45Z',
 'fuel_type': 'diesel',
 'id': 'b42e8c0a-1766-5869-b6b5-2278a04ee3da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX91354',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 142068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2020}
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX91354%27 HTTP/1.1" 200 None
2025-12-05 17:07:30 [auto1.es] INFO: Saving data for KX91354: {'auction_closing_time': 1765037025.0, 'created_time': 1762967055.873473, 'last_price_update_time': 1764954450.414896}
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX91354') HTTP/1.1" 204 0
2025-12-05 17:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_b3c0fe58b808bb05a6bf191f8d28bac9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fc250>
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_e81436a628847c9de3c596f20a65e49d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_e81436a628847c9de3c596f20a65e49d.jpg saved to cache
2025-12-05 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbeae50>
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_b3c0fe58b808bb05a6bf191f8d28bac9.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_b3c0fe58b808bb05a6bf191f8d28bac9.jpg saved to cache
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_67ca7d0821a2e6c3efb2cc3e7c74068e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_9374b9887bb16c59f7c64c82c0e3a147.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47f710>
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_67ca7d0821a2e6c3efb2cc3e7c74068e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_67ca7d0821a2e6c3efb2cc3e7c74068e.jpg saved to cache
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5994a456777d1a2f84c5946eb156f91d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db791d0>
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_9374b9887bb16c59f7c64c82c0e3a147.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_9374b9887bb16c59f7c64c82c0e3a147.jpg saved to cache
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP90075> (referer: https://www.auto1.com/v1/car-details-view/LP90075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da21650>
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F20%252F5c20afa5934b400e6453441e33506f50%252Fpa%252FMM47502_5994a456777d1a2f84c5946eb156f91d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5994a456777d1a2f84c5946eb156f91d.jpg saved to cache
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92beff75-7821-5dce-a167-6c528dd8b179
2025-12-05 17:07:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92beff75-7821-5dce-a167-6c528dd8b179, skipping ID generation
2025-12-05 17:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92beff75-7821-5dce-a167-6c528dd8b179 with scrape type 1
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 92beff75-7821-5dce-a167-6c528dd8b179 from tracking dictionaries
2025-12-05 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92beff75-7821-5dce-a167-6c528dd8b179 sending to next pipeline
2025-12-05 17:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92beff75-7821-5dce-a167-6c528dd8b179, identifier: MM47502
2025-12-05 17:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92beff75-7821-5dce-a167-6c528dd8b179 with identifier: MM47502
2025-12-05 17:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92beff75-7821-5dce-a167-6c528dd8b179 with identifier: MM47502
2025-12-05 17:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92beff75-7821-5dce-a167-6c528dd8b179 with identifier: MM47502 to the API
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5994a456777d1a2f84c5946eb156f91d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:53:04Z',
 'fuel_type': 'petrol',
 'id': '92beff75-7821-5dce-a167-6c528dd8b179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM47502',
 'listing': 'auction',
 'location': 'ES, Vélez-Málaga',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 67378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5994a456777d1a2f84c5946eb156f91d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_9374b9887bb16c59f7c64c82c0e3a147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_67ca7d0821a2e6c3efb2cc3e7c74068e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_b3c0fe58b808bb05a6bf191f8d28bac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_e81436a628847c9de3c596f20a65e49d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_1753ae5ecb68b314b74276833a3614e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_d4897202ff3f342a5b7aba784adf7769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5637554d650910033413c31f73c8f1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f216cf7cd51cdd2cddffcd6c9434f491.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_f05b1819c4ec4001198c9bef0760fd4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_756bfc8b1aede6b4ea1a27070968d449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_3c6104c476355d7867ea06af2125cdce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_cf7d035ef5b6a136fc3758cdcf7ea3c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_5b9a307e53e95b8f2458122cd0eba7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_292aa65b98871b144c24cdb8739747d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92beff75-7821-5dce-a167-6c528dd8b179/92beff75-7821-5dce-a167-6c528dd8b179_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/20/5c20afa5934b400e6453441e33506f50/pa/MM47502_2a2fa11f0926123bc9686eb1c99a0e09.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.8 TCe S-Edition',
 'transmission': 'automatic',
 'trim': 'S-Edition',
 'year': 2018}
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM47502%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [auto1.es] INFO: Saving data for MM47502: {'created_time': 1764954452.323379, 'last_price_update_time': 1764954452.323392, 'auction_closing_time': 1765039984.0}
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MM47502') HTTP/1.1" 204 0
2025-12-05 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET16826> (referer: https://www.auto1.com/v1/car-details-view/ET16826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX22323> (referer: https://www.auto1.com/v1/car-details-view/FX22323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bced6ed8-9a89-5201-a549-dc5bbb1a5e6d with identifier: LP90075
2025-12-05 17:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bced6ed8-9a89-5201-a549-dc5bbb1a5e6d with scrape type 2
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bced6ed8-9a89-5201-a549-dc5bbb1a5e6d with scrape type 2
2025-12-05 17:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bced6ed8-9a89-5201-a549-dc5bbb1a5e6d, identifier: LP90075
2025-12-05 17:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bced6ed8-9a89-5201-a549-dc5bbb1a5e6d with identifier: LP90075
2025-12-05 17:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bced6ed8-9a89-5201-a549-dc5bbb1a5e6d with identifier: LP90075
2025-12-05 17:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bced6ed8-9a89-5201-a549-dc5bbb1a5e6d with identifier: LP90075 to the API
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP90075>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:11:24Z',
 'fuel_type': 'petrol',
 'id': 'bced6ed8-9a89-5201-a549-dc5bbb1a5e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP90075',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'Skoda',
 'model': 'Scala',
 'odometer': 26764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Scala 1.0 TSI Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2024}
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP90075%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [auto1.es] INFO: Saving data for LP90075: {'auction_closing_time': 1765037484.0, 'created_time': 1763658101.427009, 'last_price_update_time': 1764954452.778355}
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP90075') HTTP/1.1" 204 0
2025-12-05 17:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee54e34b-761a-5bca-b801-32b0a93eb7e0 with identifier: ET16826
2025-12-05 17:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee54e34b-761a-5bca-b801-32b0a93eb7e0 with scrape type 2
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee54e34b-761a-5bca-b801-32b0a93eb7e0 with scrape type 2
2025-12-05 17:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee54e34b-761a-5bca-b801-32b0a93eb7e0, identifier: ET16826
2025-12-05 17:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063eb490-a01f-57a2-b439-121336ca0603 with identifier: FX22323
2025-12-05 17:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063eb490-a01f-57a2-b439-121336ca0603 with scrape type 2
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063eb490-a01f-57a2-b439-121336ca0603 with scrape type 2
2025-12-05 17:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 063eb490-a01f-57a2-b439-121336ca0603, identifier: FX22323
2025-12-05 17:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee54e34b-761a-5bca-b801-32b0a93eb7e0 with identifier: ET16826
2025-12-05 17:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee54e34b-761a-5bca-b801-32b0a93eb7e0 with identifier: ET16826
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 13234, 'odometer_reading_unit': 'km', 'registration_date': '2024-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et16826', 'expiration_date': '2025-12-06t16:59:37z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'ee54e34b-761a-5bca-b801-32b0a93eb7e0', 'current_year_diff': 1, 'age_in_months': 16, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 13234}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 16,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:59:37z',
     'fuel_type': 'petrol',
     'id': 'ee54e34b-761a-5bca-b801-32b0a93eb7e0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et16826',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 13234,
     'odometer_in_km': 13234,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-07-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2024}
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ee54e34b-761a-5bca-b801-32b0a93eb7e0 spider: auto1.es
2025-12-05 17:07:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ee54e34b-761a-5bca-b801-32b0a93eb7e0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 13234, 'odometer_reading_unit': 'km', 'registration_date': '2024-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et16826', 'expiration_date': '2025-12-06t16:59:37z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'ee54e34b-761a-5bca-b801-32b0a93eb7e0', 'current_year_diff': 1, 'age_in_months': 16, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 13234}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 16,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:59:37z',
     'fuel_type': 'petrol',
     'id': 'ee54e34b-761a-5bca-b801-32b0a93eb7e0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et16826',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 13234,
     'odometer_in_km': 13234,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-07-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:59:37Z',
 'fuel_type': 'petrol',
 'id': 'ee54e34b-761a-5bca-b801-32b0a93eb7e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET16826',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 13234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET16826%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [auto1.es] INFO: Saving data for ET16826: {'auction_closing_time': 1765040377.0, 'created_time': 1762261496.041477, 'last_price_update_time': 1764954453.181541}
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET16826') HTTP/1.1" 204 0
2025-12-05 17:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 063eb490-a01f-57a2-b439-121336ca0603 with identifier: FX22323
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 063eb490-a01f-57a2-b439-121336ca0603 with identifier: FX22323
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147759 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147759
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 063eb490-a01f-57a2-b439-121336ca0603 spider: auto1.es
2025-12-05 17:07:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 063eb490-a01f-57a2-b439-121336ca0603 due to rule: high_mileage_for_make.json, error: 147759 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147759
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-06T16:53:08Z',
 'fuel_type': 'diesel',
 'id': '063eb490-a01f-57a2-b439-121336ca0603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX22323',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 147759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2017}
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX22323%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [auto1.es] INFO: Saving data for FX22323: {'auction_closing_time': 1765039988.0, 'created_time': 1764396045.523047, 'last_price_update_time': 1764954453.398963}
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX22323') HTTP/1.1" 204 0
2025-12-05 17:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA07694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD75342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB39664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB72676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:39 [auto1.es] INFO: Parsing search results for channel: 24h
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR27399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX34380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV98550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY26160> (referer: https://www.auto1.com/v1/car-details-view/KY26160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 930cdf98-43b1-5e02-a4c4-1c142842ef9e with identifier: KY26160
2025-12-05 17:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 930cdf98-43b1-5e02-a4c4-1c142842ef9e with scrape type 2
2025-12-05 17:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 930cdf98-43b1-5e02-a4c4-1c142842ef9e with scrape type 2
2025-12-05 17:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 930cdf98-43b1-5e02-a4c4-1c142842ef9e, identifier: KY26160
2025-12-05 17:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 930cdf98-43b1-5e02-a4c4-1c142842ef9e with identifier: KY26160
2025-12-05 17:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 930cdf98-43b1-5e02-a4c4-1c142842ef9e with identifier: KY26160
2025-12-05 17:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130147 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130147
2025-12-05 17:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 930cdf98-43b1-5e02-a4c4-1c142842ef9e spider: auto1.es
2025-12-05 17:07:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 930cdf98-43b1-5e02-a4c4-1c142842ef9e due to rule: high_mileage_for_make.json, error: 130147 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130147
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:04:05Z',
 'fuel_type': 'diesel',
 'id': '930cdf98-43b1-5e02-a4c4-1c142842ef9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY26160',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 130147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2025-12-05 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY26160%27 HTTP/1.1" 200 None
2025-12-05 17:07:46 [auto1.es] INFO: Saving data for KY26160: {'auction_closing_time': 1765037045.0, 'created_time': 1762534819.754994, 'last_price_update_time': 1764954466.482177}
2025-12-05 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KY26160') HTTP/1.1" 204 0
2025-12-05 17:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ27359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS55107/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ85086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF73263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA07694> (referer: https://www.auto1.com/v1/car-details-view/PA07694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b with identifier: PA07694
2025-12-05 17:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b with scrape type 1
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_442acfb26d870c73d479840fc3c8cfa1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_442acfb26d870c73d479840fc3c8cfa1.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_3a45f658a518b531f550654df20fbc12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_3a45f658a518b531f550654df20fbc12.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_1952cabcff4f0075b82be4748c177faf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_1952cabcff4f0075b82be4748c177faf.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_a533d8a96a245ecdc9cb33e31f2e0ec6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a533d8a96a245ecdc9cb33e31f2e0ec6.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_12a7be752b8b60c495ed30568b8d17f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_12a7be752b8b60c495ed30568b8d17f2.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_34368ccf000f78418e1e434c8d270a99.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_34368ccf000f78418e1e434c8d270a99.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_8081fc0f4949f0304e035380be1dc7dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8081fc0f4949f0304e035380be1dc7dc.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_49ec37c38e3dc2a6e1f8a5ebc0b70406.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_49ec37c38e3dc2a6e1f8a5ebc0b70406.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_b8dea34f18a8320c23a15b85e7992f29.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b8dea34f18a8320c23a15b85e7992f29.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_90fd76887535f1281f90addc03b74fe2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_90fd76887535f1281f90addc03b74fe2.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_eb150140f66cbd53f65f344bf3262649.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_eb150140f66cbd53f65f344bf3262649.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_b36a5f88814584da2e5d30d4b459ea8e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b36a5f88814584da2e5d30d4b459ea8e.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_8fea6c70b930b7502518de66c10f5c87.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8fea6c70b930b7502518de66c10f5c87.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_0becaac0336c58a2512eb68f9400e8eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0becaac0336c58a2512eb68f9400e8eb.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_a606e8c8977383476f8a9fe9447ee138.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a606e8c8977383476f8a9fe9447ee138.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_0a948a11e3b9d67dba019ca746c624c2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0a948a11e3b9d67dba019ca746c624c2.jpg not downloaded yet
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD75342> (referer: https://www.auto1.com/v1/car-details-view/RD75342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM34315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY78035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf820c7b-91ca-5e00-bd36-67e263e238dc with identifier: RD75342
2025-12-05 17:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf820c7b-91ca-5e00-bd36-67e263e238dc with scrape type 2
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf820c7b-91ca-5e00-bd36-67e263e238dc with scrape type 2
2025-12-05 17:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf820c7b-91ca-5e00-bd36-67e263e238dc, identifier: RD75342
2025-12-05 17:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf820c7b-91ca-5e00-bd36-67e263e238dc with identifier: RD75342
2025-12-05 17:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf820c7b-91ca-5e00-bd36-67e263e238dc with identifier: RD75342
2025-12-05 17:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186172 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186172
2025-12-05 17:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cf820c7b-91ca-5e00-bd36-67e263e238dc spider: auto1.es
2025-12-05 17:07:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cf820c7b-91ca-5e00-bd36-67e263e238dc due to rule: high_mileage_for_country.json, error: 186172 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186172
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:26:53Z',
 'fuel_type': 'diesel',
 'id': 'cf820c7b-91ca-5e00-bd36-67e263e238dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD75342',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 186172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2016}
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD75342%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [auto1.es] INFO: Saving data for RD75342: {'auction_closing_time': 1765038413.0, 'created_time': 1764608538.440782, 'last_price_update_time': 1764954468.943125}
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD75342') HTTP/1.1" 204 0
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0becaac0336c58a2512eb68f9400e8eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0a948a11e3b9d67dba019ca746c624c2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a606e8c8977383476f8a9fe9447ee138.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB39664> (referer: https://www.auto1.com/v1/car-details-view/YB39664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b36a5f88814584da2e5d30d4b459ea8e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8fea6c70b930b7502518de66c10f5c87.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_90fd76887535f1281f90addc03b74fe2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB72676> (referer: https://www.auto1.com/v1/car-details-view/XB72676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_eb150140f66cbd53f65f344bf3262649.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7607d0>
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_0becaac0336c58a2512eb68f9400e8eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0becaac0336c58a2512eb68f9400e8eb.jpg saved to cache
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe8850>
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_0a948a11e3b9d67dba019ca746c624c2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0a948a11e3b9d67dba019ca746c624c2.jpg saved to cache
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe3810>
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_a606e8c8977383476f8a9fe9447ee138.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a606e8c8977383476f8a9fe9447ee138.jpg saved to cache
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b8dea34f18a8320c23a15b85e7992f29.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8081fc0f4949f0304e035380be1dc7dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_49ec37c38e3dc2a6e1f8a5ebc0b70406.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8d089f5-6382-504a-9db1-61df0f816c87 with identifier: YB39664
2025-12-05 17:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d089f5-6382-504a-9db1-61df0f816c87 with scrape type 2
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8d089f5-6382-504a-9db1-61df0f816c87 with scrape type 2
2025-12-05 17:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8d089f5-6382-504a-9db1-61df0f816c87, identifier: YB39664
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8d1890>
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_b36a5f88814584da2e5d30d4b459ea8e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b36a5f88814584da2e5d30d4b459ea8e.jpg saved to cache
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97cd10>
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_8fea6c70b930b7502518de66c10f5c87.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8fea6c70b930b7502518de66c10f5c87.jpg saved to cache
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db27f10>
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_90fd76887535f1281f90addc03b74fe2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_90fd76887535f1281f90addc03b74fe2.jpg saved to cache
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef99f37-98b8-54db-9f1d-1a276c1e8cad with identifier: XB72676
2025-12-05 17:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef99f37-98b8-54db-9f1d-1a276c1e8cad with scrape type 2
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef99f37-98b8-54db-9f1d-1a276c1e8cad with scrape type 2
2025-12-05 17:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eef99f37-98b8-54db-9f1d-1a276c1e8cad, identifier: XB72676
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db77810>
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_eb150140f66cbd53f65f344bf3262649.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_eb150140f66cbd53f65f344bf3262649.jpg saved to cache
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8d089f5-6382-504a-9db1-61df0f816c87 with identifier: YB39664
2025-12-05 17:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8d089f5-6382-504a-9db1-61df0f816c87 with identifier: YB39664
2025-12-05 17:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8d089f5-6382-504a-9db1-61df0f816c87 with identifier: YB39664 to the API
2025-12-05 17:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB39664>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:23:53Z',
 'fuel_type': 'petrol',
 'id': 'd8d089f5-6382-504a-9db1-61df0f816c87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB39664',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 2273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2025}
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB39664%27 HTTP/1.1" 200 None
2025-12-05 17:07:52 [auto1.es] INFO: Saving data for YB39664: {'auction_closing_time': 1765038233.0, 'created_time': 1763034599.910406, 'last_price_update_time': 1764954472.59937}
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YB39664') HTTP/1.1" 204 0
2025-12-05 17:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eef99f37-98b8-54db-9f1d-1a276c1e8cad with identifier: XB72676
2025-12-05 17:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eef99f37-98b8-54db-9f1d-1a276c1e8cad with identifier: XB72676
2025-12-05 17:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eef99f37-98b8-54db-9f1d-1a276c1e8cad with identifier: XB72676 to the API
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB72676>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:12:06Z',
 'fuel_type': 'petrol',
 'id': 'eef99f37-98b8-54db-9f1d-1a276c1e8cad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB72676',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 127659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB72676%27 HTTP/1.1" 200 None
2025-12-05 17:07:52 [auto1.es] INFO: Saving data for XB72676: {'auction_closing_time': 1765037526.0, 'created_time': 1763460549.646904, 'last_price_update_time': 1764954472.996213}
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB72676') HTTP/1.1" 204 0
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR27399> (referer: https://www.auto1.com/v1/car-details-view/TR27399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX34380> (referer: https://www.auto1.com/v1/car-details-view/SX34380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT53511> (referer: https://www.auto1.com/v1/car-details-view/DT53511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab2ed0>
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_b8dea34f18a8320c23a15b85e7992f29.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b8dea34f18a8320c23a15b85e7992f29.jpg saved to cache
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d907e50>
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_8081fc0f4949f0304e035380be1dc7dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8081fc0f4949f0304e035380be1dc7dc.jpg saved to cache
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d906590>
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_49ec37c38e3dc2a6e1f8a5ebc0b70406.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_49ec37c38e3dc2a6e1f8a5ebc0b70406.jpg saved to cache
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_34368ccf000f78418e1e434c8d270a99.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a533d8a96a245ecdc9cb33e31f2e0ec6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_12a7be752b8b60c495ed30568b8d17f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ62505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae044be-114e-59a7-8444-705e92837c3f with identifier: TR27399
2025-12-05 17:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae044be-114e-59a7-8444-705e92837c3f with scrape type 1
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3ae044be-114e-59a7-8444-705e92837c3f
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_5e63c9be2a676acf474886fe7178cdb8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_5e63c9be2a676acf474886fe7178cdb8.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_79857d9d17afc93fe55ec1c9bb19162e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_79857d9d17afc93fe55ec1c9bb19162e.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_f060d32bc92a99cd1b7b2c0b7a28feed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_f060d32bc92a99cd1b7b2c0b7a28feed.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_8f277351193a0238b60c6b562351997d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_8f277351193a0238b60c6b562351997d.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_06b49fb5ffde156980c253efabbc34ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_06b49fb5ffde156980c253efabbc34ce.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_a06ab007c52ebbb7dbf33d4efcad6cbf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_a06ab007c52ebbb7dbf33d4efcad6cbf.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_c1915877290b63ef438e3f54191bfb7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_c1915877290b63ef438e3f54191bfb7c.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_539198122e25ab35d8bdce6b07a340b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_539198122e25ab35d8bdce6b07a340b7.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_337f23149e5f6f690e1409e6e349bde0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_337f23149e5f6f690e1409e6e349bde0.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_184b4c7cee1dda0382444ea88cb2723e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_184b4c7cee1dda0382444ea88cb2723e.jpg already downloaded
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_227637005a7bda28a6fc2e40158c429d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_227637005a7bda28a6fc2e40158c429d.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_a9a804545cef90dbb54485bf91ab394f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_a9a804545cef90dbb54485bf91ab394f.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_7c5d46affa9ccdfe17c67739bebf7c39.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_7c5d46affa9ccdfe17c67739bebf7c39.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_84113e153ce073d22c786c998737e7ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_84113e153ce073d22c786c998737e7ed.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_1c29690cb6a1f341a590854a6d620651.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_1c29690cb6a1f341a590854a6d620651.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F0c%252Fcd0c8a28476d6057eba2625c3f54894f%252Fpa%252FTR27399_3116e50e437b39701c3208247bc79972.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_3116e50e437b39701c3208247bc79972.jpg already downloaded
2025-12-05 17:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ae044be-114e-59a7-8444-705e92837c3f, identifier: TR27399
2025-12-05 17:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc521ee8-d5d1-5f77-8011-2ac2129e3a75 with identifier: SX34380
2025-12-05 17:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75 with scrape type 1
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_138013bad5f14b63362c851f00aa9d1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_138013bad5f14b63362c851f00aa9d1e.jpg not downloaded yet
2025-12-05 17:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c38a943-cc59-5e40-a336-c4868da14c73 with identifier: DT53511
2025-12-05 17:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c38a943-cc59-5e40-a336-c4868da14c73 with scrape type 1
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3c38a943-cc59-5e40-a336-c4868da14c73
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_6517ca114024e03e21480fdbb6032219.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6517ca114024e03e21480fdbb6032219.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_dde4e0d1649c6c988e9f8b2e8da64557.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_dde4e0d1649c6c988e9f8b2e8da64557.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_1498dc45c300ef3b50d9e03ddb81571b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_1498dc45c300ef3b50d9e03ddb81571b.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_b4a4ef3de82f34f2d820c0b951ab8329.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_b4a4ef3de82f34f2d820c0b951ab8329.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_6cb95bf0c085553270f0173fcca1bada.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6cb95bf0c085553270f0173fcca1bada.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_b5a9b67b06e47962538cb60f6431394f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_b5a9b67b06e47962538cb60f6431394f.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_80cd38c3ea4aebef30977a65b29e9ad4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_80cd38c3ea4aebef30977a65b29e9ad4.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_ee0b727d7aceb9eba002279a0af87200.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_ee0b727d7aceb9eba002279a0af87200.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_e2f5dabe87e25d89e15e3ac3997af0e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_e2f5dabe87e25d89e15e3ac3997af0e6.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_d65f6943b2250b16c23238e0aee82ca7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_d65f6943b2250b16c23238e0aee82ca7.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_6c81aaed1f0a08863982cec0abe708ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6c81aaed1f0a08863982cec0abe708ef.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_c0e5269d39911811bc5ab85833d00c71.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_c0e5269d39911811bc5ab85833d00c71.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_30546139ea4e39d43cccbf9c01e6922d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_30546139ea4e39d43cccbf9c01e6922d.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_265c99da06664621119d14803f9b045b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_265c99da06664621119d14803f9b045b.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_c733e13e449add2f303388c4e1a814ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_c733e13e449add2f303388c4e1a814ab.jpg already downloaded
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F53%252F7c53285f7c01d11e45c0c6b1de170e42%252Fpa%252FDT53511_d7e22fff31513843af32a25b692b045b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_d7e22fff31513843af32a25b692b045b.jpg already downloaded
2025-12-05 17:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c38a943-cc59-5e40-a336-c4868da14c73, identifier: DT53511
2025-12-05 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ae044be-114e-59a7-8444-705e92837c3f with identifier: TR27399
2025-12-05 17:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ae044be-114e-59a7-8444-705e92837c3f with identifier: TR27399
2025-12-05 17:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195107 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195107
2025-12-05 17:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3ae044be-114e-59a7-8444-705e92837c3f spider: auto1.es
2025-12-05 17:07:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3ae044be-114e-59a7-8444-705e92837c3f due to rule: high_mileage_for_country.json, error: 195107 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195107
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:21:47Z',
 'fuel_type': 'petrol',
 'id': '3ae044be-114e-59a7-8444-705e92837c3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR27399',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 195107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_5e63c9be2a676acf474886fe7178cdb8.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_79857d9d17afc93fe55ec1c9bb19162e.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_f060d32bc92a99cd1b7b2c0b7a28feed.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_8f277351193a0238b60c6b562351997d.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_06b49fb5ffde156980c253efabbc34ce.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_a06ab007c52ebbb7dbf33d4efcad6cbf.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_c1915877290b63ef438e3f54191bfb7c.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_539198122e25ab35d8bdce6b07a340b7.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_337f23149e5f6f690e1409e6e349bde0.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_184b4c7cee1dda0382444ea88cb2723e.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_227637005a7bda28a6fc2e40158c429d.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_a9a804545cef90dbb54485bf91ab394f.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_7c5d46affa9ccdfe17c67739bebf7c39.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_84113e153ce073d22c786c998737e7ed.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_1c29690cb6a1f341a590854a6d620651.jpg',
                'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_3116e50e437b39701c3208247bc79972.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2496713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_5e63c9be2a676acf474886fe7178cdb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_79857d9d17afc93fe55ec1c9bb19162e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1951892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_f060d32bc92a99cd1b7b2c0b7a28feed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_8f277351193a0238b60c6b562351997d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_06b49fb5ffde156980c253efabbc34ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_a06ab007c52ebbb7dbf33d4efcad6cbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_c1915877290b63ef438e3f54191bfb7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_539198122e25ab35d8bdce6b07a340b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_337f23149e5f6f690e1409e6e349bde0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_184b4c7cee1dda0382444ea88cb2723e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_227637005a7bda28a6fc2e40158c429d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_a9a804545cef90dbb54485bf91ab394f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3218413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_7c5d46affa9ccdfe17c67739bebf7c39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3024390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_84113e153ce073d22c786c998737e7ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_1c29690cb6a1f341a590854a6d620651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae044be-114e-59a7-8444-705e92837c3f/3ae044be-114e-59a7-8444-705e92837c3f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/0c/cd0c8a28476d6057eba2625c3f54894f/pa/TR27399_3116e50e437b39701c3208247bc79972.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR27399%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.es] INFO: Saving data for TR27399: {'created_time': 1764954474.880374, 'last_price_update_time': 1764954474.880385, 'auction_closing_time': 1765038107.0}
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR27399') HTTP/1.1" 204 0
2025-12-05 17:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c38a943-cc59-5e40-a336-c4868da14c73 with identifier: DT53511
2025-12-05 17:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c38a943-cc59-5e40-a336-c4868da14c73 with identifier: DT53511
2025-12-05 17:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c38a943-cc59-5e40-a336-c4868da14c73 with identifier: DT53511 to the API
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT53511>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 158,
 'expiration_date': '2025-12-06T16:49:11Z',
 'fuel_type': 'hybrid',
 'id': '3c38a943-cc59-5e40-a336-c4868da14c73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT53511',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 20824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6517ca114024e03e21480fdbb6032219.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_dde4e0d1649c6c988e9f8b2e8da64557.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_1498dc45c300ef3b50d9e03ddb81571b.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_b4a4ef3de82f34f2d820c0b951ab8329.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6cb95bf0c085553270f0173fcca1bada.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_b5a9b67b06e47962538cb60f6431394f.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_80cd38c3ea4aebef30977a65b29e9ad4.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_ee0b727d7aceb9eba002279a0af87200.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_e2f5dabe87e25d89e15e3ac3997af0e6.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_d65f6943b2250b16c23238e0aee82ca7.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6c81aaed1f0a08863982cec0abe708ef.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_c0e5269d39911811bc5ab85833d00c71.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_30546139ea4e39d43cccbf9c01e6922d.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_265c99da06664621119d14803f9b045b.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_c733e13e449add2f303388c4e1a814ab.jpg',
                'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_d7e22fff31513843af32a25b692b045b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6517ca114024e03e21480fdbb6032219.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_dde4e0d1649c6c988e9f8b2e8da64557.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_1498dc45c300ef3b50d9e03ddb81571b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314068,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_b4a4ef3de82f34f2d820c0b951ab8329.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6cb95bf0c085553270f0173fcca1bada.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_b5a9b67b06e47962538cb60f6431394f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_80cd38c3ea4aebef30977a65b29e9ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_ee0b727d7aceb9eba002279a0af87200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_e2f5dabe87e25d89e15e3ac3997af0e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2315749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_d65f6943b2250b16c23238e0aee82ca7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_6c81aaed1f0a08863982cec0abe708ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_c0e5269d39911811bc5ab85833d00c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2254882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_30546139ea4e39d43cccbf9c01e6922d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2239661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_265c99da06664621119d14803f9b045b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_c733e13e449add2f303388c4e1a814ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38a943-cc59-5e40-a336-c4868da14c73/3c38a943-cc59-5e40-a336-c4868da14c73_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/53/7c53285f7c01d11e45c0c6b1de170e42/pa/DT53511_d7e22fff31513843af32a25b692b045b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2020}
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT53511%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.es] INFO: Saving data for DT53511: {'created_time': 1764954475.487927, 'last_price_update_time': 1764954475.48794, 'auction_closing_time': 1765039751.0}
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DT53511') HTTP/1.1" 204 0
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg not downloaded yet
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_3a45f658a518b531f550654df20fbc12.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_442acfb26d870c73d479840fc3c8cfa1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_1952cabcff4f0075b82be4748c177faf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_6425cb50c583da0e4ece30b9de0cff25.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_6425cb50c583da0e4ece30b9de0cff25.jpg not downloaded yet
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9050d0>
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_34368ccf000f78418e1e434c8d270a99.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_34368ccf000f78418e1e434c8d270a99.jpg saved to cache
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d90db10>
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_a533d8a96a245ecdc9cb33e31f2e0ec6.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a533d8a96a245ecdc9cb33e31f2e0ec6.jpg saved to cache
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbdf710>
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_12a7be752b8b60c495ed30568b8d17f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_12a7be752b8b60c495ed30568b8d17f2.jpg saved to cache
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_aeeba2aadf1e96f08f00f4b20a6205b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_aeeba2aadf1e96f08f00f4b20a6205b6.jpg not downloaded yet
2025-12-05 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_138013bad5f14b63362c851f00aa9d1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_9bdfc956f2d274eb68f9c39628472c4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_9bdfc956f2d274eb68f9c39628472c4f.jpg not downloaded yet
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48ead0>
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_3a45f658a518b531f550654df20fbc12.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_3a45f658a518b531f550654df20fbc12.jpg saved to cache
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6de610>
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_442acfb26d870c73d479840fc3c8cfa1.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_442acfb26d870c73d479840fc3c8cfa1.jpg saved to cache
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6ddd10>
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc7%252Fa5c7030bf9f7e1026a4736adf344b0d6%252Fpa%252FPA07694_1952cabcff4f0075b82be4748c177faf.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_1952cabcff4f0075b82be4748c177faf.jpg saved to cache
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b
2025-12-05 17:07:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b, skipping ID generation
2025-12-05 17:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b with scrape type 1
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b from tracking dictionaries
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b sending to next pipeline
2025-12-05 17:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b, identifier: PA07694
2025-12-05 17:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b with identifier: PA07694
2025-12-05 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b with identifier: PA07694
2025-12-05 17:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d0a8e34-c254-528c-b6c0-d40e2aaaf31b with identifier: PA07694 to the API
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_1952cabcff4f0075b82be4748c177faf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:12:05Z',
 'fuel_type': 'petrol',
 'id': '2d0a8e34-c254-528c-b6c0-d40e2aaaf31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA07694',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 139604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_442acfb26d870c73d479840fc3c8cfa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_3a45f658a518b531f550654df20fbc12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_1952cabcff4f0075b82be4748c177faf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a533d8a96a245ecdc9cb33e31f2e0ec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_12a7be752b8b60c495ed30568b8d17f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_34368ccf000f78418e1e434c8d270a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8081fc0f4949f0304e035380be1dc7dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_49ec37c38e3dc2a6e1f8a5ebc0b70406.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b8dea34f18a8320c23a15b85e7992f29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_90fd76887535f1281f90addc03b74fe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_eb150140f66cbd53f65f344bf3262649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_b36a5f88814584da2e5d30d4b459ea8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_8fea6c70b930b7502518de66c10f5c87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0becaac0336c58a2512eb68f9400e8eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_a606e8c8977383476f8a9fe9447ee138.jpg',
             'Width': 586},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0a8e34-c254-528c-b6c0-d40e2aaaf31b/2d0a8e34-c254-528c-b6c0-d40e2aaaf31b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c7/a5c7030bf9f7e1026a4736adf344b0d6/pa/PA07694_0a948a11e3b9d67dba019ca746c624c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA07694%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.es] INFO: Saving data for PA07694: {'created_time': 1764954477.451691, 'last_price_update_time': 1764954477.451701, 'auction_closing_time': 1765037525.0}
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA07694') HTTP/1.1" 204 0
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_d61786fd2f6b56924f90ef79684e546a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d61786fd2f6b56924f90ef79684e546a.jpg not downloaded yet
2025-12-05 17:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC96824> (referer: https://www.auto1.com/v1/car-details-view/EC96824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ27359> (referer: https://www.auto1.com/v1/car-details-view/BJ27359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba1910>
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_138013bad5f14b63362c851f00aa9d1e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_138013bad5f14b63362c851f00aa9d1e.jpg saved to cache
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_d9b3d4940ec9de27455a5907aabe2050.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d9b3d4940ec9de27455a5907aabe2050.jpg not downloaded yet
2025-12-05 17:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_aeeba2aadf1e96f08f00f4b20a6205b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_2eeb97d48f4eeabf16c8f9bf1b09f376.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_2eeb97d48f4eeabf16c8f9bf1b09f376.jpg not downloaded yet
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_a76c0e58e6339472e41feb38ca074c1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_a76c0e58e6339472e41feb38ca074c1d.jpg not downloaded yet
2025-12-05 17:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c04171e-4d38-524d-b0c2-513345224e1e with identifier: EC96824
2025-12-05 17:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c04171e-4d38-524d-b0c2-513345224e1e with scrape type 2
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c04171e-4d38-524d-b0c2-513345224e1e with scrape type 2
2025-12-05 17:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c04171e-4d38-524d-b0c2-513345224e1e, identifier: EC96824
2025-12-05 17:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 with identifier: BJ27359
2025-12-05 17:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 with scrape type 1
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg not downloaded yet
2025-12-05 17:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c04171e-4d38-524d-b0c2-513345224e1e with identifier: EC96824
2025-12-05 17:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c04171e-4d38-524d-b0c2-513345224e1e with identifier: EC96824
2025-12-05 17:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157252 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157252
2025-12-05 17:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4c04171e-4d38-524d-b0c2-513345224e1e spider: auto1.es
2025-12-05 17:07:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4c04171e-4d38-524d-b0c2-513345224e1e due to rule: high_mileage_for_country.json, error: 157252 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157252
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:23:43Z',
 'fuel_type': 'diesel',
 'id': '4c04171e-4d38-524d-b0c2-513345224e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC96824',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 157252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D165 Mild-Hybrid AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC96824%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [auto1.es] INFO: Saving data for EC96824: {'auction_closing_time': 1765038223.0, 'created_time': 1762945658.083693, 'last_price_update_time': 1764954478.371279}
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EC96824') HTTP/1.1" 204 0
2025-12-05 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d61786fd2f6b56924f90ef79684e546a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_9bdfc956f2d274eb68f9c39628472c4f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_4c068587995384d230b1f333c384aa4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_4c068587995384d230b1f333c384aa4c.jpg not downloaded yet
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg not downloaded yet
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_de1c7dc3fea41ba232016802fd7130b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_de1c7dc3fea41ba232016802fd7130b5.jpg not downloaded yet
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg not downloaded yet
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6dce10>
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_aeeba2aadf1e96f08f00f4b20a6205b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_aeeba2aadf1e96f08f00f4b20a6205b6.jpg saved to cache
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_a76c0e58e6339472e41feb38ca074c1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_db95945186bb678e0fdb81a5a570efa4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_db95945186bb678e0fdb81a5a570efa4.jpg not downloaded yet
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg not downloaded yet
2025-12-05 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_f904ae3b02a09ca4a0b2425f9cddbc81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_f904ae3b02a09ca4a0b2425f9cddbc81.jpg not downloaded yet
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_1a5c42009c78cce57851214956e78a7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg not downloaded yet
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5654d0>
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_d61786fd2f6b56924f90ef79684e546a.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d61786fd2f6b56924f90ef79684e546a.jpg saved to cache
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da98350>
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_9bdfc956f2d274eb68f9c39628472c4f.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_9bdfc956f2d274eb68f9c39628472c4f.jpg saved to cache
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg not downloaded yet
2025-12-05 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_7031b5648734213dec08122666984e02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg not downloaded yet
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b0510>
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_a76c0e58e6339472e41feb38ca074c1d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_a76c0e58e6339472e41feb38ca074c1d.jpg saved to cache
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5bfb50>
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg saved to cache
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_de1c7dc3fea41ba232016802fd7130b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg not downloaded yet
2025-12-05 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF73263> (referer: https://www.auto1.com/v1/car-details-view/GF73263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg not downloaded yet
2025-12-05 17:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54b590>
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg saved to cache
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_f4db86605398823a876f623ed8721592.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg not downloaded yet
2025-12-05 17:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg not downloaded yet
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e459e90>
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_de1c7dc3fea41ba232016802fd7130b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_de1c7dc3fea41ba232016802fd7130b5.jpg saved to cache
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8abd260f-4454-5905-a37f-ebba625840ce with identifier: GF73263
2025-12-05 17:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8abd260f-4454-5905-a37f-ebba625840ce with scrape type 1
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_c3d88e4f225210c879a30186efa5fd01.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c3d88e4f225210c879a30186efa5fd01.jpg not downloaded yet
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg not downloaded yet
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_c01dd35239f549c2249da00b09647b2c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c01dd35239f549c2249da00b09647b2c.jpg not downloaded yet
2025-12-05 17:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668daf9f90>
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_7031b5648734213dec08122666984e02.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg saved to cache
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b3c50>
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_1a5c42009c78cce57851214956e78a7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg saved to cache
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_bc14e6895919ab65f3d13128202d955b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg not downloaded yet
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_6206db25f08b12029cba7c5681f40c6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6206db25f08b12029cba7c5681f40c6f.jpg not downloaded yet
2025-12-05 17:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_0b431f911039abc61520b24355a57ea2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg not downloaded yet
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_1564d3e58ca979ff0be2e8af23c33533.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_1564d3e58ca979ff0be2e8af23c33533.jpg not downloaded yet
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e67a550>
2025-12-05 17:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg saved to cache
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c3d88e4f225210c879a30186efa5fd01.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg not downloaded yet
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_43cd7c7d9dc6c6f7c3761639bb941dbb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_43cd7c7d9dc6c6f7c3761639bb941dbb.jpg not downloaded yet
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9057d0>
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_f4db86605398823a876f623ed8721592.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg saved to cache
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d97d6d0>
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg saved to cache
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg not downloaded yet
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_519a0eb2224582ea528b826f5009735a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_519a0eb2224582ea528b826f5009735a.jpg not downloaded yet
2025-12-05 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6206db25f08b12029cba7c5681f40c6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_62fb5a884a3af474fe97f9b4c6c2d568.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_62fb5a884a3af474fe97f9b4c6c2d568.jpg not downloaded yet
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5c7050>
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_c3d88e4f225210c879a30186efa5fd01.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c3d88e4f225210c879a30186efa5fd01.jpg saved to cache
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_1564d3e58ca979ff0be2e8af23c33533.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_3805eb8855b6682b1e9d3e0df9b59179.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_3805eb8855b6682b1e9d3e0df9b59179.jpg not downloaded yet
2025-12-05 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV98550> (referer: https://www.auto1.com/v1/car-details-view/FV98550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e448a90>
2025-12-05 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_6206db25f08b12029cba7c5681f40c6f.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6206db25f08b12029cba7c5681f40c6f.jpg saved to cache
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6c050>
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_bc14e6895919ab65f3d13128202d955b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg saved to cache
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_47cb0f5bd2e13af4a51324bebb57033a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_47cb0f5bd2e13af4a51324bebb57033a.jpg not downloaded yet
2025-12-05 17:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_519a0eb2224582ea528b826f5009735a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_fb088639cb97fd8c607ec1997c22f474.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_fb088639cb97fd8c607ec1997c22f474.jpg not downloaded yet
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e67bc90>
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_1564d3e58ca979ff0be2e8af23c33533.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_1564d3e58ca979ff0be2e8af23c33533.jpg saved to cache
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2025-12-05 17:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53eb734-9f85-5b69-9861-5858f18c7942 with scrape type 1
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_0438a7436f92679cca2c1be025383488.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0438a7436f92679cca2c1be025383488.jpg not downloaded yet
2025-12-05 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_62fb5a884a3af474fe97f9b4c6c2d568.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_752756e13fb39b9ce80d7d87d9f84af7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_752756e13fb39b9ce80d7d87d9f84af7.jpg not downloaded yet
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_9131c921e970b891a3431e20a5a453df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_9131c921e970b891a3431e20a5a453df.jpg not downloaded yet
2025-12-05 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_3805eb8855b6682b1e9d3e0df9b59179.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e57c3d0>
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_519a0eb2224582ea528b826f5009735a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_519a0eb2224582ea528b826f5009735a.jpg saved to cache
2025-12-05 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e826b50>
2025-12-05 17:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg saved to cache
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_6481c2236483ad9638253054f3cdc11e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6481c2236483ad9638253054f3cdc11e.jpg not downloaded yet
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_d3bd5a7120d091259e7a43f03527acc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_d3bd5a7120d091259e7a43f03527acc6.jpg not downloaded yet
2025-12-05 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_43cd7c7d9dc6c6f7c3761639bb941dbb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_47cb0f5bd2e13af4a51324bebb57033a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_56ecf887a4e4c1b32b0aae439b9f75fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_56ecf887a4e4c1b32b0aae439b9f75fe.jpg not downloaded yet
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_da802735d91ac8d4b6fa0f541c37e072.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_da802735d91ac8d4b6fa0f541c37e072.jpg not downloaded yet
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e568890>
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_62fb5a884a3af474fe97f9b4c6c2d568.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_62fb5a884a3af474fe97f9b4c6c2d568.jpg saved to cache
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f1610>
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_3805eb8855b6682b1e9d3e0df9b59179.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_3805eb8855b6682b1e9d3e0df9b59179.jpg saved to cache
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0438a7436f92679cca2c1be025383488.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_fb088639cb97fd8c607ec1997c22f474.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_397f250e2797f49698f539ab55b89344.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_397f250e2797f49698f539ab55b89344.jpg not downloaded yet
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_b64c33f3480f9d6cd8cf9a34c77a5162.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_b64c33f3480f9d6cd8cf9a34c77a5162.jpg not downloaded yet
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dabdf50>
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_43cd7c7d9dc6c6f7c3761639bb941dbb.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_43cd7c7d9dc6c6f7c3761639bb941dbb.jpg saved to cache
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e56b2d0>
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_47cb0f5bd2e13af4a51324bebb57033a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_47cb0f5bd2e13af4a51324bebb57033a.jpg saved to cache
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_d3bd5a7120d091259e7a43f03527acc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_bcdfc6e6e1730d99795546d1471fdf0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_bcdfc6e6e1730d99795546d1471fdf0f.jpg not downloaded yet
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_fa73ed07d661564660e00d7f82369f43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fa73ed07d661564660e00d7f82369f43.jpg not downloaded yet
2025-12-05 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_9131c921e970b891a3431e20a5a453df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_b9994dd7db42edb1d137e8ebea3307b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_b9994dd7db42edb1d137e8ebea3307b0.jpg not downloaded yet
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_8a06f4571303cb2fc1971e2f152069c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_8a06f4571303cb2fc1971e2f152069c1.jpg not downloaded yet
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc20410>
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_0438a7436f92679cca2c1be025383488.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0438a7436f92679cca2c1be025383488.jpg saved to cache
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e44acd0>
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_fb088639cb97fd8c607ec1997c22f474.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_fb088639cb97fd8c607ec1997c22f474.jpg saved to cache
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_da802735d91ac8d4b6fa0f541c37e072.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_b64c33f3480f9d6cd8cf9a34c77a5162.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_56ecf887a4e4c1b32b0aae439b9f75fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_25501a5c891e5a2d5a0c1bca68759a8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_25501a5c891e5a2d5a0c1bca68759a8c.jpg not downloaded yet
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_5d8b15204417964312ab09f3149b9c76.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_5d8b15204417964312ab09f3149b9c76.jpg not downloaded yet
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbead10>
2025-12-05 17:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_d3bd5a7120d091259e7a43f03527acc6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_d3bd5a7120d091259e7a43f03527acc6.jpg saved to cache
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db78450>
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_9131c921e970b891a3431e20a5a453df.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_9131c921e970b891a3431e20a5a453df.jpg saved to cache
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_72499413ede329360da8d97160475797.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_72499413ede329360da8d97160475797.jpg not downloaded yet
2025-12-05 17:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fa73ed07d661564660e00d7f82369f43.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_8a06f4571303cb2fc1971e2f152069c1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_397f250e2797f49698f539ab55b89344.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_b9994dd7db42edb1d137e8ebea3307b0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_fdc08f153f5ab9acfb7443e933b09832.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fdc08f153f5ab9acfb7443e933b09832.jpg not downloaded yet
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71ed50>
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_da802735d91ac8d4b6fa0f541c37e072.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_da802735d91ac8d4b6fa0f541c37e072.jpg saved to cache
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54b390>
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_b64c33f3480f9d6cd8cf9a34c77a5162.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_b64c33f3480f9d6cd8cf9a34c77a5162.jpg saved to cache
2025-12-05 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71ec50>
2025-12-05 17:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_56ecf887a4e4c1b32b0aae439b9f75fe.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_56ecf887a4e4c1b32b0aae439b9f75fe.jpg saved to cache
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_0761e34aa016ff000edf3b24f51c697d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0761e34aa016ff000edf3b24f51c697d.jpg not downloaded yet
2025-12-05 17:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_5d8b15204417964312ab09f3149b9c76.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_25501a5c891e5a2d5a0c1bca68759a8c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_bcdfc6e6e1730d99795546d1471fdf0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_65355a27dbe2b81e671cea7af4aca56c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_65355a27dbe2b81e671cea7af4aca56c.jpg not downloaded yet
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da9ab90>
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_fa73ed07d661564660e00d7f82369f43.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fa73ed07d661564660e00d7f82369f43.jpg saved to cache
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94b2d0>
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_8a06f4571303cb2fc1971e2f152069c1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_8a06f4571303cb2fc1971e2f152069c1.jpg saved to cache
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d7110>
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_397f250e2797f49698f539ab55b89344.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_397f250e2797f49698f539ab55b89344.jpg saved to cache
2025-12-05 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e825e10>
2025-12-05 17:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_b9994dd7db42edb1d137e8ebea3307b0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_b9994dd7db42edb1d137e8ebea3307b0.jpg saved to cache
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_72499413ede329360da8d97160475797.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fdc08f153f5ab9acfb7443e933b09832.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6481c2236483ad9638253054f3cdc11e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbdb1d0>
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_5d8b15204417964312ab09f3149b9c76.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_5d8b15204417964312ab09f3149b9c76.jpg saved to cache
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da71dd0>
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_25501a5c891e5a2d5a0c1bca68759a8c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_25501a5c891e5a2d5a0c1bca68759a8c.jpg saved to cache
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e2710>
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_bcdfc6e6e1730d99795546d1471fdf0f.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_bcdfc6e6e1730d99795546d1471fdf0f.jpg saved to cache
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0761e34aa016ff000edf3b24f51c697d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_752756e13fb39b9ce80d7d87d9f84af7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_65355a27dbe2b81e671cea7af4aca56c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6c41d0>
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_72499413ede329360da8d97160475797.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_72499413ede329360da8d97160475797.jpg saved to cache
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc21e50>
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_fdc08f153f5ab9acfb7443e933b09832.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fdc08f153f5ab9acfb7443e933b09832.jpg saved to cache
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8e8cd0>
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_6481c2236483ad9638253054f3cdc11e.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6481c2236483ad9638253054f3cdc11e.jpg saved to cache
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c01dd35239f549c2249da00b09647b2c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:08 [scrapy.extensions.logstats] INFO: Crawled 717 pages (at 36 pages/min), scraped 203 items (at 6 items/min)
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc26350>
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_0761e34aa016ff000edf3b24f51c697d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0761e34aa016ff000edf3b24f51c697d.jpg saved to cache
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7b8c90>
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_752756e13fb39b9ce80d7d87d9f84af7.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_752756e13fb39b9ce80d7d87d9f84af7.jpg saved to cache
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48cfd0>
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F79%252F0e7981e7a0eed029bc75bf6dce78861f%252Fpa%252FFV98550_65355a27dbe2b81e671cea7af4aca56c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_65355a27dbe2b81e671cea7af4aca56c.jpg saved to cache
2025-12-05 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e53eb734-9f85-5b69-9861-5858f18c7942
2025-12-05 17:08:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53eb734-9f85-5b69-9861-5858f18c7942, skipping ID generation
2025-12-05 17:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53eb734-9f85-5b69-9861-5858f18c7942 with scrape type 1
2025-12-05 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e53eb734-9f85-5b69-9861-5858f18c7942 from tracking dictionaries
2025-12-05 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53eb734-9f85-5b69-9861-5858f18c7942 sending to next pipeline
2025-12-05 17:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e53eb734-9f85-5b69-9861-5858f18c7942, identifier: FV98550
2025-12-05 17:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b1010>
2025-12-05 17:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg saved to cache
2025-12-05 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2025-12-05 17:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2025-12-05 17:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550 to the API
2025-12-05 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_65355a27dbe2b81e671cea7af4aca56c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:07:52Z',
 'fuel_type': 'diesel',
 'id': 'e53eb734-9f85-5b69-9861-5858f18c7942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV98550',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 80603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39640,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0438a7436f92679cca2c1be025383488.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39440,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_9131c921e970b891a3431e20a5a453df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58373,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_d3bd5a7120d091259e7a43f03527acc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36642,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_da802735d91ac8d4b6fa0f541c37e072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37939,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_b64c33f3480f9d6cd8cf9a34c77a5162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39440,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fa73ed07d661564660e00d7f82369f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37124,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_8a06f4571303cb2fc1971e2f152069c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37065,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_25501a5c891e5a2d5a0c1bca68759a8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50181,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_5d8b15204417964312ab09f3149b9c76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39440,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_72499413ede329360da8d97160475797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58373,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_fdc08f153f5ab9acfb7443e933b09832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51748,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_0761e34aa016ff000edf3b24f51c697d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb734-9f85-5b69-9861-5858f18c7942/e53eb734-9f85-5b69-9861-5858f18c7942_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74120,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/79/0e7981e7a0eed029bc75bf6dce78861f/pa/FV98550_65355a27dbe2b81e671cea7af4aca56c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2025-12-05 17:08:10 [auto1.es] INFO: Saving data for FV98550: {'created_time': 1764954490.139169, 'last_price_update_time': 1764954490.13918, 'auction_closing_time': 1765037272.0}
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV98550') HTTP/1.1" 204 0
2025-12-05 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_f904ae3b02a09ca4a0b2425f9cddbc81.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6e290>
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F88%252F9b881588430ce4557230cd3133695b88%252Fpa%252FGF73263_c01dd35239f549c2249da00b09647b2c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c01dd35239f549c2249da00b09647b2c.jpg saved to cache
2025-12-05 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8abd260f-4454-5905-a37f-ebba625840ce
2025-12-05 17:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8abd260f-4454-5905-a37f-ebba625840ce, skipping ID generation
2025-12-05 17:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8abd260f-4454-5905-a37f-ebba625840ce with scrape type 1
2025-12-05 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8abd260f-4454-5905-a37f-ebba625840ce from tracking dictionaries
2025-12-05 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8abd260f-4454-5905-a37f-ebba625840ce sending to next pipeline
2025-12-05 17:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8abd260f-4454-5905-a37f-ebba625840ce, identifier: GF73263
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d95bd10>
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_0b431f911039abc61520b24355a57ea2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg saved to cache
2025-12-05 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8abd260f-4454-5905-a37f-ebba625840ce with identifier: GF73263
2025-12-05 17:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8abd260f-4454-5905-a37f-ebba625840ce with identifier: GF73263
2025-12-05 17:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8abd260f-4454-5905-a37f-ebba625840ce with identifier: GF73263 to the API
2025-12-05 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c01dd35239f549c2249da00b09647b2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:03:12Z',
 'fuel_type': 'diesel',
 'id': '8abd260f-4454-5905-a37f-ebba625840ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF73263',
 'listing': 'auction',
 'location': 'ES, Almería',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 101630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c3d88e4f225210c879a30186efa5fd01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_c01dd35239f549c2249da00b09647b2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6206db25f08b12029cba7c5681f40c6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_1564d3e58ca979ff0be2e8af23c33533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_43cd7c7d9dc6c6f7c3761639bb941dbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_519a0eb2224582ea528b826f5009735a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_62fb5a884a3af474fe97f9b4c6c2d568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_3805eb8855b6682b1e9d3e0df9b59179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_47cb0f5bd2e13af4a51324bebb57033a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_fb088639cb97fd8c607ec1997c22f474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_752756e13fb39b9ce80d7d87d9f84af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_6481c2236483ad9638253054f3cdc11e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_56ecf887a4e4c1b32b0aae439b9f75fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_397f250e2797f49698f539ab55b89344.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_bcdfc6e6e1730d99795546d1471fdf0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8abd260f-4454-5905-a37f-ebba625840ce/8abd260f-4454-5905-a37f-ebba625840ce_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/88/9b881588430ce4557230cd3133695b88/pa/GF73263_b9994dd7db42edb1d137e8ebea3307b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF73263%27 HTTP/1.1" 200 None
2025-12-05 17:08:11 [auto1.es] INFO: Saving data for GF73263: {'created_time': 1764954491.131359, 'last_price_update_time': 1764954491.131369, 'auction_closing_time': 1765036992.0}
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF73263') HTTP/1.1" 204 0
2025-12-05 17:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_db95945186bb678e0fdb81a5a570efa4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_4c068587995384d230b1f333c384aa4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da2abd0>
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg saved to cache
2025-12-05 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a4bd0>
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg saved to cache
2025-12-05 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8fd490>
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_f904ae3b02a09ca4a0b2425f9cddbc81.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_f904ae3b02a09ca4a0b2425f9cddbc81.jpg saved to cache
2025-12-05 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668daf93d0>
2025-12-05 17:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg saved to cache
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX42113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d96e090>
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_db95945186bb678e0fdb81a5a570efa4.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_db95945186bb678e0fdb81a5a570efa4.jpg saved to cache
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc24c50>
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_4c068587995384d230b1f333c384aa4c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_4c068587995384d230b1f333c384aa4c.jpg saved to cache
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9042d0>
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg saved to cache
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_2eeb97d48f4eeabf16c8f9bf1b09f376.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_6425cb50c583da0e4ece30b9de0cff25.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d9b3d4940ec9de27455a5907aabe2050.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY78035> (referer: https://www.auto1.com/v1/car-details-view/MY78035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS55107> (referer: https://www.auto1.com/v1/car-details-view/YS55107/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a5e50>
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F11%252Fe411cd70cea53912f0eb1aabff756d86%252Fpa%252FBJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg saved to cache
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073
2025-12-05 17:08:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073, skipping ID generation
2025-12-05 17:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 with scrape type 1
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 from tracking dictionaries
2025-12-05 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 sending to next pipeline
2025-12-05 17:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073, identifier: BJ27359
2025-12-05 17:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 with identifier: BJ27359
2025-12-05 17:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 with identifier: BJ27359
2025-12-05 17:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech blue lease active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 158140, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bj27359', 'expiration_date': '2025-12-06t16:47:19z', 'origin_country_code': 'es', 'trim': 'blue lease active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, puerto de santa maría', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': 'c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90606}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79693}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82093}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78793}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57327}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80096}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82267}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70094}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58398}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59350}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74517}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 103820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93287}], 'current_year_diff': 8, 'age_in_months': 100, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 158140}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2025-12-06t16:47:19z',
     'fuel_type': 'petrol',
     'id': 'c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bj27359',
     'listing': 'auction',
     'location': 'es, puerto de santa maría',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 158140,
     'odometer_in_km': 158140,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 90606,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79693,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82093,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78793,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78478,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72147,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57327,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80096,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82267,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70094,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58398,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59350,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74517,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45281,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 103820,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 93287,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech blue lease active',
     'transmission': 'manual',
     'trim': 'blue lease active',
     'year': 2017}
2025-12-05 17:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 spider: auto1.es
2025-12-05 17:08:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech blue lease active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 158140, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bj27359', 'expiration_date': '2025-12-06t16:47:19z', 'origin_country_code': 'es', 'trim': 'blue lease active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, puerto de santa maría', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': 'c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90606}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79693}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82093}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78793}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57327}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80096}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82267}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70094}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58398}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59350}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74517}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 103820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93287}], 'current_year_diff': 8, 'age_in_months': 100, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 158140}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2025-12-06t16:47:19z',
     'fuel_type': 'petrol',
     'id': 'c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bj27359',
     'listing': 'auction',
     'location': 'es, puerto de santa maría',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 158140,
     'odometer_in_km': 158140,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 90606,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79693,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82093,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78793,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78478,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72147,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57327,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80096,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82267,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70094,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58398,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59350,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74517,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45281,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 103820,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 93287,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech blue lease active',
     'transmission': 'manual',
     'trim': 'blue lease active',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:47:19Z',
 'fuel_type': 'petrol',
 'id': 'c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ27359',
 'listing': 'auction',
 'location': 'ES, Puerto de Santa María',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 158140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_db6e7b937321a894e7cae2ee5e091cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c97c1e0424d99a552838c49fb5f42e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_56632fcf12268ebe138e85fbc33cbf3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_4662185124c8c3c170e5e466e1a4dd7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_1a5c42009c78cce57851214956e78a7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_39f827200fa057e8afbf2ed74ffa6212.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7031b5648734213dec08122666984e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_b3921c80f81ecfe7b39d8b36a0d47179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_741c3bdeda48eb87d6fc35132cbcdc1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_f4db86605398823a876f623ed8721592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_c9c433ef36e88d4a32bfd85b474b1375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_7d69c9c8e2f3cf139c646f0566119175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_bc14e6895919ab65f3d13128202d955b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_0b431f911039abc61520b24355a57ea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_fa672e4440850bfe1f323a80c0f900b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073/c9e4fd2f-c1dc-5c0c-aac5-334b6e9d0073_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/11/e411cd70cea53912f0eb1aabff756d86/pa/BJ27359_5bb8ee6517a7387c69b8ac1ca057e32d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Blue Lease Active',
 'transmission': 'manual',
 'trim': 'Blue Lease Active',
 'year': 2017}
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ27359%27 HTTP/1.1" 200 None
2025-12-05 17:08:13 [auto1.es] INFO: Saving data for BJ27359: {'created_time': 1764954493.302457, 'last_price_update_time': 1764954493.302467, 'auction_closing_time': 1765039639.0}
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BJ27359') HTTP/1.1" 204 0
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d904e90>
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_2eeb97d48f4eeabf16c8f9bf1b09f376.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_2eeb97d48f4eeabf16c8f9bf1b09f376.jpg saved to cache
2025-12-05 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b3bd0>
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_6425cb50c583da0e4ece30b9de0cff25.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_6425cb50c583da0e4ece30b9de0cff25.jpg saved to cache
2025-12-05 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b2cd0>
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_d9b3d4940ec9de27455a5907aabe2050.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d9b3d4940ec9de27455a5907aabe2050.jpg saved to cache
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e8368d0>
2025-12-05 17:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fed%252F67eda0a71befdd6ee4814ce7588d56d4%252Fpa%252FSX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg saved to cache
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75
2025-12-05 17:08:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc521ee8-d5d1-5f77-8011-2ac2129e3a75, skipping ID generation
2025-12-05 17:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75 with scrape type 1
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc521ee8-d5d1-5f77-8011-2ac2129e3a75 from tracking dictionaries
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc521ee8-d5d1-5f77-8011-2ac2129e3a75 sending to next pipeline
2025-12-05 17:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc521ee8-d5d1-5f77-8011-2ac2129e3a75, identifier: SX34380
2025-12-05 17:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a012ec0-e94a-5812-a7a0-267c5b86129f with identifier: MY78035
2025-12-05 17:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a012ec0-e94a-5812-a7a0-267c5b86129f with scrape type 1
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 5a012ec0-e94a-5812-a7a0-267c5b86129f
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_f6d554908b1767bb442c7ab99577f25a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_f6d554908b1767bb442c7ab99577f25a.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_35cfc7f28b6f0a1fd3a42a16b7557271.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_35cfc7f28b6f0a1fd3a42a16b7557271.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_6b1f638c151d4f139cf2b5b9b64e9504.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_6b1f638c151d4f139cf2b5b9b64e9504.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_d8823edf9a0abb8239415b307292fcc0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_d8823edf9a0abb8239415b307292fcc0.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_66f6fffd59a67721b7d1118bd6235b6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_66f6fffd59a67721b7d1118bd6235b6e.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_c988ab727fb0260f327ec5f82a3ebd82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_c988ab727fb0260f327ec5f82a3ebd82.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_df58ec42dcb27f569fce572ddb12f71e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_df58ec42dcb27f569fce572ddb12f71e.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_48c26d16458bba128fd4f48f026b5e78.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_48c26d16458bba128fd4f48f026b5e78.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_0e3f3e66091ce7731653558368ec5584.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_0e3f3e66091ce7731653558368ec5584.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_0c3918d632ed59decf68387d4c270005.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_0c3918d632ed59decf68387d4c270005.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_3a111eef051d47deb3a1a21a4e9bb087.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_3a111eef051d47deb3a1a21a4e9bb087.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_7860b6c5786491e557c21890c1657ef6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_7860b6c5786491e557c21890c1657ef6.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_84964365ea8dcddaec4a0a1d66cc53ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_84964365ea8dcddaec4a0a1d66cc53ff.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_77da2c4461f04ca2b382556c83396db3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_77da2c4461f04ca2b382556c83396db3.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_9d5f9e462a133cbbd4b2bc439a8f4ae0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_9d5f9e462a133cbbd4b2bc439a8f4ae0.jpg already downloaded
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d49618154f348def7790195d97de536%252Fpa%252FMY78035_c6dec9ac172f55b58e890cb16fca19dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_c6dec9ac172f55b58e890cb16fca19dd.jpg already downloaded
2025-12-05 17:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a012ec0-e94a-5812-a7a0-267c5b86129f, identifier: MY78035
2025-12-05 17:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98aa0920-1e41-5d02-b72b-a364aab952ab with identifier: YS55107
2025-12-05 17:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98aa0920-1e41-5d02-b72b-a364aab952ab with scrape type 1
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_6daf3db95d82ba9c0473644c04637be3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_6daf3db95d82ba9c0473644c04637be3.jpg not downloaded yet
2025-12-05 17:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc521ee8-d5d1-5f77-8011-2ac2129e3a75 with identifier: SX34380
2025-12-05 17:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc521ee8-d5d1-5f77-8011-2ac2129e3a75 with identifier: SX34380
2025-12-05 17:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc521ee8-d5d1-5f77-8011-2ac2129e3a75 with identifier: SX34380 to the API
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:10:40Z',
 'fuel_type': 'diesel',
 'id': 'fc521ee8-d5d1-5f77-8011-2ac2129e3a75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX34380',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 66436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36598,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_138013bad5f14b63362c851f00aa9d1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36598,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d3e79eba1ddcfe55f3d137f7848f3021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36598,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_6425cb50c583da0e4ece30b9de0cff25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32843,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_aeeba2aadf1e96f08f00f4b20a6205b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35170,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_9bdfc956f2d274eb68f9c39628472c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34389,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d61786fd2f6b56924f90ef79684e546a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34389,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_d9b3d4940ec9de27455a5907aabe2050.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34389,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_2eeb97d48f4eeabf16c8f9bf1b09f376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48459,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_a76c0e58e6339472e41feb38ca074c1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61620,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_4c068587995384d230b1f333c384aa4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61620,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_de1c7dc3fea41ba232016802fd7130b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60587,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_db95945186bb678e0fdb81a5a570efa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc521ee8-d5d1-5f77-8011-2ac2129e3a75/fc521ee8-d5d1-5f77-8011-2ac2129e3a75_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67806,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ed/67eda0a71befdd6ee4814ce7588d56d4/pa/SX34380_f904ae3b02a09ca4a0b2425f9cddbc81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX34380%27 HTTP/1.1" 200 None
2025-12-05 17:08:15 [auto1.es] INFO: Saving data for SX34380: {'created_time': 1764954495.668885, 'last_price_update_time': 1764954495.668894, 'auction_closing_time': 1765037440.0}
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SX34380') HTTP/1.1" 204 0
2025-12-05 17:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a012ec0-e94a-5812-a7a0-267c5b86129f with identifier: MY78035
2025-12-05 17:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a012ec0-e94a-5812-a7a0-267c5b86129f with identifier: MY78035
2025-12-05 17:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a012ec0-e94a-5812-a7a0-267c5b86129f with identifier: MY78035 to the API
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MY78035>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:26:07Z',
 'fuel_type': 'petrol',
 'id': '5a012ec0-e94a-5812-a7a0-267c5b86129f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY78035',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 43929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_f6d554908b1767bb442c7ab99577f25a.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_35cfc7f28b6f0a1fd3a42a16b7557271.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_6b1f638c151d4f139cf2b5b9b64e9504.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_d8823edf9a0abb8239415b307292fcc0.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_66f6fffd59a67721b7d1118bd6235b6e.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_c988ab727fb0260f327ec5f82a3ebd82.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_df58ec42dcb27f569fce572ddb12f71e.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_48c26d16458bba128fd4f48f026b5e78.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_0e3f3e66091ce7731653558368ec5584.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_0c3918d632ed59decf68387d4c270005.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_3a111eef051d47deb3a1a21a4e9bb087.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_7860b6c5786491e557c21890c1657ef6.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_84964365ea8dcddaec4a0a1d66cc53ff.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_77da2c4461f04ca2b382556c83396db3.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_9d5f9e462a133cbbd4b2bc439a8f4ae0.jpg',
                'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_c6dec9ac172f55b58e890cb16fca19dd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_f6d554908b1767bb442c7ab99577f25a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_35cfc7f28b6f0a1fd3a42a16b7557271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_6b1f638c151d4f139cf2b5b9b64e9504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_d8823edf9a0abb8239415b307292fcc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_66f6fffd59a67721b7d1118bd6235b6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_c988ab727fb0260f327ec5f82a3ebd82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_df58ec42dcb27f569fce572ddb12f71e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_48c26d16458bba128fd4f48f026b5e78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_0e3f3e66091ce7731653558368ec5584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_0c3918d632ed59decf68387d4c270005.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_3a111eef051d47deb3a1a21a4e9bb087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_7860b6c5786491e557c21890c1657ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_84964365ea8dcddaec4a0a1d66cc53ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_77da2c4461f04ca2b382556c83396db3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_9d5f9e462a133cbbd4b2bc439a8f4ae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a012ec0-e94a-5812-a7a0-267c5b86129f/5a012ec0-e94a-5812-a7a0-267c5b86129f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d49618154f348def7790195d97de536/pa/MY78035_c6dec9ac172f55b58e890cb16fca19dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY78035%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [auto1.es] INFO: Saving data for MY78035: {'created_time': 1764954496.061079, 'last_price_update_time': 1764954496.061091, 'auction_closing_time': 1765038367.0}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY78035') HTTP/1.1" 204 0
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_5eb5510a8b69406d953bc044b73d3121.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_5eb5510a8b69406d953bc044b73d3121.jpg not downloaded yet
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW34811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP14303> (referer: https://www.auto1.com/v1/car-details-view/EP14303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_f65182ab9d624cece858d87d83d839ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_f65182ab9d624cece858d87d83d839ec.jpg not downloaded yet
2025-12-05 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_275b83342ce3c6e91df7c27b8c9b1aef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_275b83342ce3c6e91df7c27b8c9b1aef.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_e9ae2992d4909367c46ed7e45445f687.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_e9ae2992d4909367c46ed7e45445f687.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_76daf8bbb6699046a52343356ea7de1c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_76daf8bbb6699046a52343356ea7de1c.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_8f8569221fb369af6d22ea80461a450e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_8f8569221fb369af6d22ea80461a450e.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_7d1dfda3f071db86799bca6e23124011.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_7d1dfda3f071db86799bca6e23124011.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_ef4d21ef8bdb57e1adb32485455f194b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ef4d21ef8bdb57e1adb32485455f194b.jpg not downloaded yet
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_6daf3db95d82ba9c0473644c04637be3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_33c5eb97e2475b590f84d2ed630f91be.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_33c5eb97e2475b590f84d2ed630f91be.jpg not downloaded yet
2025-12-05 17:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b97b56c-aa2f-5157-beb4-ee2a281ffbba with identifier: EP14303
2025-12-05 17:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b97b56c-aa2f-5157-beb4-ee2a281ffbba with scrape type 2
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b97b56c-aa2f-5157-beb4-ee2a281ffbba with scrape type 2
2025-12-05 17:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b97b56c-aa2f-5157-beb4-ee2a281ffbba, identifier: EP14303
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_db25bab49b9e09ea88fad56394b86135.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_db25bab49b9e09ea88fad56394b86135.jpg not downloaded yet
2025-12-05 17:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b97b56c-aa2f-5157-beb4-ee2a281ffbba with identifier: EP14303
2025-12-05 17:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b97b56c-aa2f-5157-beb4-ee2a281ffbba with identifier: EP14303
2025-12-05 17:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b97b56c-aa2f-5157-beb4-ee2a281ffbba with identifier: EP14303 to the API
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP14303>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:34:32Z',
 'fuel_type': 'diesel',
 'id': '2b97b56c-aa2f-5157-beb4-ee2a281ffbba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP14303',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 53513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP14303%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [auto1.es] INFO: Saving data for EP14303: {'auction_closing_time': 1765038872.0, 'created_time': 1761584716.455634, 'last_price_update_time': 1764954496.881645}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP14303') HTTP/1.1" 204 0
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_5eb5510a8b69406d953bc044b73d3121.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_32e52c82c8ea10a2b9f07445009aec0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_32e52c82c8ea10a2b9f07445009aec0b.jpg not downloaded yet
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbda810>
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_6daf3db95d82ba9c0473644c04637be3.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_6daf3db95d82ba9c0473644c04637be3.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_9710cf26c676025f8d1b50e42f3650ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_9710cf26c676025f8d1b50e42f3650ab.jpg not downloaded yet
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ef4d21ef8bdb57e1adb32485455f194b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS87786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e49a350>
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_5eb5510a8b69406d953bc044b73d3121.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_5eb5510a8b69406d953bc044b73d3121.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_1c11954fd9aa4ebe5efdc1eb0f0c884d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_1c11954fd9aa4ebe5efdc1eb0f0c884d.jpg not downloaded yet
2025-12-05 17:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_db25bab49b9e09ea88fad56394b86135.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_74152a3f0ece7a59e4dd51463e56875c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_74152a3f0ece7a59e4dd51463e56875c.jpg not downloaded yet
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5e3050>
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_ef4d21ef8bdb57e1adb32485455f194b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ef4d21ef8bdb57e1adb32485455f194b.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_9710cf26c676025f8d1b50e42f3650ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_ae18553f0b52f19e32953996fa4b2f7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ae18553f0b52f19e32953996fa4b2f7b.jpg not downloaded yet
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_32e52c82c8ea10a2b9f07445009aec0b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ85086> (referer: https://www.auto1.com/v1/car-details-view/XZ85086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM34315> (referer: https://www.auto1.com/v1/car-details-view/RM34315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669054b490>
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_db25bab49b9e09ea88fad56394b86135.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_db25bab49b9e09ea88fad56394b86135.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_1c11954fd9aa4ebe5efdc1eb0f0c884d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE51179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d941450>
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_9710cf26c676025f8d1b50e42f3650ab.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_9710cf26c676025f8d1b50e42f3650ab.jpg saved to cache
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac5310>
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_32e52c82c8ea10a2b9f07445009aec0b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_32e52c82c8ea10a2b9f07445009aec0b.jpg saved to cache
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb17508-87c2-5dfa-95f9-c866c41fb3d5 with identifier: XZ85086
2025-12-05 17:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb17508-87c2-5dfa-95f9-c866c41fb3d5 with scrape type 2
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eb17508-87c2-5dfa-95f9-c866c41fb3d5 with scrape type 2
2025-12-05 17:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2eb17508-87c2-5dfa-95f9-c866c41fb3d5, identifier: XZ85086
2025-12-05 17:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315
2025-12-05 17:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b325d5-54fd-56e6-8d5a-90708621380c with scrape type 2
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b325d5-54fd-56e6-8d5a-90708621380c with scrape type 2
2025-12-05 17:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6b325d5-54fd-56e6-8d5a-90708621380c, identifier: RM34315
2025-12-05 17:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2eb17508-87c2-5dfa-95f9-c866c41fb3d5 with identifier: XZ85086
2025-12-05 17:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2eb17508-87c2-5dfa-95f9-c866c41fb3d5 with identifier: XZ85086
2025-12-05 17:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2eb17508-87c2-5dfa-95f9-c866c41fb3d5 with identifier: XZ85086 to the API
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XZ85086>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:07:08Z',
 'fuel_type': 'hybrid',
 'id': '2eb17508-87c2-5dfa-95f9-c866c41fb3d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ85086',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 46172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x4 Rivoli',
 'transmission': 'automatic',
 'trim': '4x4 Rivoli',
 'year': 2022}
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ85086%27 HTTP/1.1" 200 None
2025-12-05 17:08:19 [auto1.es] INFO: Saving data for XZ85086: {'auction_closing_time': 1765037228.0, 'created_time': 1762347608.434133, 'last_price_update_time': 1764954499.676599}
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ85086') HTTP/1.1" 204 0
2025-12-05 17:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315
2025-12-05 17:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315
2025-12-05 17:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6b325d5-54fd-56e6-8d5a-90708621380c with identifier: RM34315 to the API
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM34315>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:21:19Z',
 'fuel_type': 'diesel',
 'id': 'b6b325d5-54fd-56e6-8d5a-90708621380c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM34315',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 95324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2020}
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM34315%27 HTTP/1.1" 200 None
2025-12-05 17:08:20 [auto1.es] INFO: Saving data for RM34315: {'auction_closing_time': 1765038079.0, 'created_time': 1762495282.145358, 'last_price_update_time': 1764954500.052261}
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RM34315') HTTP/1.1" 204 0
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_74152a3f0ece7a59e4dd51463e56875c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ae18553f0b52f19e32953996fa4b2f7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_33c5eb97e2475b590f84d2ed630f91be.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ62505> (referer: https://www.auto1.com/v1/car-details-view/XZ62505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6f450>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_1c11954fd9aa4ebe5efdc1eb0f0c884d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_1c11954fd9aa4ebe5efdc1eb0f0c884d.jpg saved to cache
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_7d1dfda3f071db86799bca6e23124011.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c4f50>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_74152a3f0ece7a59e4dd51463e56875c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_74152a3f0ece7a59e4dd51463e56875c.jpg saved to cache
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7c5650>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_ae18553f0b52f19e32953996fa4b2f7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ae18553f0b52f19e32953996fa4b2f7b.jpg saved to cache
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6c4810>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_33c5eb97e2475b590f84d2ed630f91be.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_33c5eb97e2475b590f84d2ed630f91be.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505
2025-12-05 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6318819-4e1b-5e2c-8810-ce170762400c with scrape type 1
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_9ba95a95690c6c2b5c85ca7c125ede86.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_9ba95a95690c6c2b5c85ca7c125ede86.jpg not downloaded yet
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_8f8569221fb369af6d22ea80461a450e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_275b83342ce3c6e91df7c27b8c9b1aef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_a5f947c82302351da1288f5393158f59.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a5f947c82302351da1288f5393158f59.jpg not downloaded yet
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_76daf8bbb6699046a52343356ea7de1c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_e9ae2992d4909367c46ed7e45445f687.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND76145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe3c90>
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_7d1dfda3f071db86799bca6e23124011.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_7d1dfda3f071db86799bca6e23124011.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_6356f24400a7ff413991c24c16e45f0d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_6356f24400a7ff413991c24c16e45f0d.jpg not downloaded yet
2025-12-05 17:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_b93db549730d05151d98c209da59e2ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_b93db549730d05151d98c209da59e2ce.jpg not downloaded yet
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d932850>
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_8f8569221fb369af6d22ea80461a450e.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_8f8569221fb369af6d22ea80461a450e.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82c0d0>
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_275b83342ce3c6e91df7c27b8c9b1aef.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_275b83342ce3c6e91df7c27b8c9b1aef.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82c790>
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_76daf8bbb6699046a52343356ea7de1c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_76daf8bbb6699046a52343356ea7de1c.jpg saved to cache
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82ed90>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_e9ae2992d4909367c46ed7e45445f687.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_e9ae2992d4909367c46ed7e45445f687.jpg saved to cache
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_9ba95a95690c6c2b5c85ca7c125ede86.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a5f947c82302351da1288f5393158f59.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_be3fd9311a39a42c31b344cc6898e774.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_be3fd9311a39a42c31b344cc6898e774.jpg not downloaded yet
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_f65182ab9d624cece858d87d83d839ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC87241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_a2340238952db43fafc9807b17133297.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a2340238952db43fafc9807b17133297.jpg not downloaded yet
2025-12-05 17:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_f5ececd728c5099c4ebeecc79ee4ab80.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_f5ececd728c5099c4ebeecc79ee4ab80.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_3aa9c3562121b6dfdcbd1c9adfb51e85.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_3aa9c3562121b6dfdcbd1c9adfb51e85.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_1a07841f936313d15067f88003445bac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_1a07841f936313d15067f88003445bac.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_d9a6741c2e6965ebaf062bd2ca72906c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_d9a6741c2e6965ebaf062bd2ca72906c.jpg not downloaded yet
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_6356f24400a7ff413991c24c16e45f0d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_be3fd9311a39a42c31b344cc6898e774.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_4ad3462b5c7009a71b90e5ddd6756d13.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_4ad3462b5c7009a71b90e5ddd6756d13.jpg not downloaded yet
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7ebf50>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_9ba95a95690c6c2b5c85ca7c125ede86.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_9ba95a95690c6c2b5c85ca7c125ede86.jpg saved to cache
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6dd850>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_a5f947c82302351da1288f5393158f59.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a5f947c82302351da1288f5393158f59.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_aa009000d2508613a4efbc84b38ae657.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_aa009000d2508613a4efbc84b38ae657.jpg not downloaded yet
2025-12-05 17:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_b93db549730d05151d98c209da59e2ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_8ba89413dc0c7a2546370e58f98be55e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_8ba89413dc0c7a2546370e58f98be55e.jpg not downloaded yet
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6c7090>
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fb6%252F67b601dc28310369ac1f7d41b5ae88d5%252Fpa%252FYS55107_f65182ab9d624cece858d87d83d839ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_f65182ab9d624cece858d87d83d839ec.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98aa0920-1e41-5d02-b72b-a364aab952ab
2025-12-05 17:08:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98aa0920-1e41-5d02-b72b-a364aab952ab, skipping ID generation
2025-12-05 17:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98aa0920-1e41-5d02-b72b-a364aab952ab with scrape type 1
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 98aa0920-1e41-5d02-b72b-a364aab952ab from tracking dictionaries
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98aa0920-1e41-5d02-b72b-a364aab952ab sending to next pipeline
2025-12-05 17:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98aa0920-1e41-5d02-b72b-a364aab952ab, identifier: YS55107
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6ec50>
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_6356f24400a7ff413991c24c16e45f0d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_6356f24400a7ff413991c24c16e45f0d.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e82d690>
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_be3fd9311a39a42c31b344cc6898e774.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_be3fd9311a39a42c31b344cc6898e774.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98aa0920-1e41-5d02-b72b-a364aab952ab with identifier: YS55107
2025-12-05 17:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98aa0920-1e41-5d02-b72b-a364aab952ab with identifier: YS55107
2025-12-05 17:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98aa0920-1e41-5d02-b72b-a364aab952ab with identifier: YS55107 to the API
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_f65182ab9d624cece858d87d83d839ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:46:08Z',
 'fuel_type': 'diesel',
 'id': '98aa0920-1e41-5d02-b72b-a364aab952ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS55107',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 12234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_6daf3db95d82ba9c0473644c04637be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_5eb5510a8b69406d953bc044b73d3121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_f65182ab9d624cece858d87d83d839ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_275b83342ce3c6e91df7c27b8c9b1aef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_e9ae2992d4909367c46ed7e45445f687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_76daf8bbb6699046a52343356ea7de1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_8f8569221fb369af6d22ea80461a450e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_7d1dfda3f071db86799bca6e23124011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ef4d21ef8bdb57e1adb32485455f194b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_33c5eb97e2475b590f84d2ed630f91be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_db25bab49b9e09ea88fad56394b86135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_32e52c82c8ea10a2b9f07445009aec0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_9710cf26c676025f8d1b50e42f3650ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_1c11954fd9aa4ebe5efdc1eb0f0c884d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_74152a3f0ece7a59e4dd51463e56875c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98aa0920-1e41-5d02-b72b-a364aab952ab/98aa0920-1e41-5d02-b72b-a364aab952ab_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/b6/67b601dc28310369ac1f7d41b5ae88d5/pa/YS55107_ae18553f0b52f19e32953996fa4b2f7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Sport BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport BlueMotion Tech',
 'year': 2017}
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS55107%27 HTTP/1.1" 200 None
2025-12-05 17:08:24 [auto1.es] INFO: Saving data for YS55107: {'created_time': 1764954504.332606, 'last_price_update_time': 1764954504.332615, 'auction_closing_time': 1765039568.0}
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YS55107') HTTP/1.1" 204 0
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_1a07841f936313d15067f88003445bac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_d9a6741c2e6965ebaf062bd2ca72906c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da16310>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_b93db549730d05151d98c209da59e2ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_b93db549730d05151d98c209da59e2ce.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_aa009000d2508613a4efbc84b38ae657.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db26090>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_1a07841f936313d15067f88003445bac.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_1a07841f936313d15067f88003445bac.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da161d0>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_d9a6741c2e6965ebaf062bd2ca72906c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_d9a6741c2e6965ebaf062bd2ca72906c.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_4ad3462b5c7009a71b90e5ddd6756d13.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_8ba89413dc0c7a2546370e58f98be55e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da72bd0>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_aa009000d2508613a4efbc84b38ae657.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_aa009000d2508613a4efbc84b38ae657.jpg saved to cache
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_3aa9c3562121b6dfdcbd1c9adfb51e85.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cf210>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_4ad3462b5c7009a71b90e5ddd6756d13.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_4ad3462b5c7009a71b90e5ddd6756d13.jpg saved to cache
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da22290>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_8ba89413dc0c7a2546370e58f98be55e.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_8ba89413dc0c7a2546370e58f98be55e.jpg saved to cache
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_f5ececd728c5099c4ebeecc79ee4ab80.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a2340238952db43fafc9807b17133297.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab1410>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_3aa9c3562121b6dfdcbd1c9adfb51e85.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_3aa9c3562121b6dfdcbd1c9adfb51e85.jpg saved to cache
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e729190>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_f5ececd728c5099c4ebeecc79ee4ab80.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_f5ececd728c5099c4ebeecc79ee4ab80.jpg saved to cache
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dad7690>
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcb%252F8ccbccfde4d56a44578675a11626efb7%252Fpa%252FXZ62505_a2340238952db43fafc9807b17133297.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a2340238952db43fafc9807b17133297.jpg saved to cache
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6318819-4e1b-5e2c-8810-ce170762400c
2025-12-05 17:08:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6318819-4e1b-5e2c-8810-ce170762400c, skipping ID generation
2025-12-05 17:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6318819-4e1b-5e2c-8810-ce170762400c with scrape type 1
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a6318819-4e1b-5e2c-8810-ce170762400c from tracking dictionaries
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6318819-4e1b-5e2c-8810-ce170762400c sending to next pipeline
2025-12-05 17:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a6318819-4e1b-5e2c-8810-ce170762400c, identifier: XZ62505
2025-12-05 17:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505
2025-12-05 17:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505
2025-12-05 17:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505 to the API
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a2340238952db43fafc9807b17133297.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:18:27Z',
 'fuel_type': 'diesel',
 'id': 'a6318819-4e1b-5e2c-8810-ce170762400c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ62505',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 32878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39834,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_9ba95a95690c6c2b5c85ca7c125ede86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39834,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a5f947c82302351da1288f5393158f59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32066,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_6356f24400a7ff413991c24c16e45f0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33373,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_b93db549730d05151d98c209da59e2ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36461,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_be3fd9311a39a42c31b344cc6898e774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39834,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_a2340238952db43fafc9807b17133297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31975,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_f5ececd728c5099c4ebeecc79ee4ab80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39701,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_3aa9c3562121b6dfdcbd1c9adfb51e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50218,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_1a07841f936313d15067f88003445bac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39701,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_d9a6741c2e6965ebaf062bd2ca72906c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57413,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_4ad3462b5c7009a71b90e5ddd6756d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54815,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_aa009000d2508613a4efbc84b38ae657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6318819-4e1b-5e2c-8810-ce170762400c/a6318819-4e1b-5e2c-8810-ce170762400c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77346,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cb/8ccbccfde4d56a44578675a11626efb7/pa/XZ62505_8ba89413dc0c7a2546370e58f98be55e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62505%27 HTTP/1.1" 200 None
2025-12-05 17:08:26 [auto1.es] INFO: Saving data for XZ62505: {'created_time': 1764954506.762999, 'last_price_update_time': 1764954506.763009, 'auction_closing_time': 1765037907.0}
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ62505') HTTP/1.1" 204 0
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK10680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS87786> (referer: https://www.auto1.com/v1/car-details-view/PS87786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 with identifier: PS87786
2025-12-05 17:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 with scrape type 1
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_29cea061f87019158c26c53bf9c9777c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_29cea061f87019158c26c53bf9c9777c.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_cb81817febbcb0d22b2f3cc54e88c847.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_cb81817febbcb0d22b2f3cc54e88c847.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_37afc5853388c185981ccf91728fdf97.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_37afc5853388c185981ccf91728fdf97.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_9342011aeb028e7f7c805d389e7fc928.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_9342011aeb028e7f7c805d389e7fc928.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_f6c065cc12c82df811e200695adb594a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_f6c065cc12c82df811e200695adb594a.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_e5a76a28888e00efa4ec64735b33dfc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_e5a76a28888e00efa4ec64735b33dfc6.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_3f3fbb388802894be2a3f16589fae9dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f3fbb388802894be2a3f16589fae9dd.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_1bd9d4e431ec66be3351e4572691e973.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_1bd9d4e431ec66be3351e4572691e973.jpg not downloaded yet
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_2d1c9814a3e93d5542ee30c324de83cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2d1c9814a3e93d5542ee30c324de83cb.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_83aceecc315939ab4444591b1038faa1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_83aceecc315939ab4444591b1038faa1.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_d9fe8a746105def351a9383f08417f66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d9fe8a746105def351a9383f08417f66.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_3f2e98395870f158ee0ffbfea1eb77f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f2e98395870f158ee0ffbfea1eb77f1.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_2b9047e9d6276165a6be80865609effe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2b9047e9d6276165a6be80865609effe.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_d057ba36bef953a9b195b73da94895d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d057ba36bef953a9b195b73da94895d6.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_6c4ff4ab5c6b86f58de065c6a00e657a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_6c4ff4ab5c6b86f58de065c6a00e657a.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_128107c581fbd638f8c4d2d95a69df8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_128107c581fbd638f8c4d2d95a69df8a.jpg not downloaded yet
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE51179> (referer: https://www.auto1.com/v1/car-details-view/DE51179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM18367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179
2025-12-05 17:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45624cdd-c209-5b62-82e2-d303a80525c2 with scrape type 1
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_487c392c12751493f04545805b2ee18a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_487c392c12751493f04545805b2ee18a.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_bff59c75310eaaf169744ed2900616d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_bff59c75310eaaf169744ed2900616d2.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_868b3b3692bccc081a8eb8b5602201d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_868b3b3692bccc081a8eb8b5602201d6.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_ef9e17efc023357d5705b36a5a4e09b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ef9e17efc023357d5705b36a5a4e09b6.jpg not downloaded yet
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_128107c581fbd638f8c4d2d95a69df8a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_0e2c8871937159f41d46ba55f6cda93f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0e2c8871937159f41d46ba55f6cda93f.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_210cb136b340f915277c62f75eb879c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_210cb136b340f915277c62f75eb879c8.jpg not downloaded yet
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU54823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_3cd5aef5e47f6529a4537371f0a13359.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_3cd5aef5e47f6529a4537371f0a13359.jpg not downloaded yet
2025-12-05 17:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_b6cd65e3e61f9242b0ea729a51d39d6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b6cd65e3e61f9242b0ea729a51d39d6b.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_b94dc9576f77895a111dc960108d3098.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b94dc9576f77895a111dc960108d3098.jpg not downloaded yet
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_ed29b56797614b15c1025fc819073471.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ed29b56797614b15c1025fc819073471.jpg not downloaded yet
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_6c4ff4ab5c6b86f58de065c6a00e657a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_0691663c41d25291ecfa18581b1a87a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0691663c41d25291ecfa18581b1a87a5.jpg not downloaded yet
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_210cb136b340f915277c62f75eb879c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_df60330efc371f6d7c0cc793b6a542ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_df60330efc371f6d7c0cc793b6a542ae.jpg not downloaded yet
2025-12-05 17:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dac4390>
2025-12-05 17:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_128107c581fbd638f8c4d2d95a69df8a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_128107c581fbd638f8c4d2d95a69df8a.jpg saved to cache
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ed29b56797614b15c1025fc819073471.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW34811> (referer: https://www.auto1.com/v1/car-details-view/NW34811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c5190>
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_6c4ff4ab5c6b86f58de065c6a00e657a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_6c4ff4ab5c6b86f58de065c6a00e657a.jpg saved to cache
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b0f90>
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_210cb136b340f915277c62f75eb879c8.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_210cb136b340f915277c62f75eb879c8.jpg saved to cache
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0691663c41d25291ecfa18581b1a87a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_df60330efc371f6d7c0cc793b6a542ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d96f990>
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_ed29b56797614b15c1025fc819073471.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ed29b56797614b15c1025fc819073471.jpg saved to cache
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e353615-b792-5fec-87de-37aba0684abc with identifier: NW34811
2025-12-05 17:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e353615-b792-5fec-87de-37aba0684abc with scrape type 1
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_e7df07327070a93c8f226f19096232db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e7df07327070a93c8f226f19096232db.jpg not downloaded yet
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b94dc9576f77895a111dc960108d3098.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_c4a4b200cfa62dec3a9091859cae8a42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_c4a4b200cfa62dec3a9091859cae8a42.jpg not downloaded yet
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU76295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cc0d0>
2025-12-05 17:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_0691663c41d25291ecfa18581b1a87a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0691663c41d25291ecfa18581b1a87a5.jpg saved to cache
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e78b990>
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_df60330efc371f6d7c0cc793b6a542ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_df60330efc371f6d7c0cc793b6a542ae.jpg saved to cache
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_092b513a631e3d65d47740ca765bea46.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_092b513a631e3d65d47740ca765bea46.jpg not downloaded yet
2025-12-05 17:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b6cd65e3e61f9242b0ea729a51d39d6b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_9d30c9dbe0b9390db682ff0d1bd1167c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_9d30c9dbe0b9390db682ff0d1bd1167c.jpg not downloaded yet
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8e99d0>
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_b94dc9576f77895a111dc960108d3098.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b94dc9576f77895a111dc960108d3098.jpg saved to cache
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e7df07327070a93c8f226f19096232db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_c4a4b200cfa62dec3a9091859cae8a42.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_e8d5bd4bd86e5e0a801b39d3b3062777.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e8d5bd4bd86e5e0a801b39d3b3062777.jpg not downloaded yet
2025-12-05 17:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC87241> (referer: https://www.auto1.com/v1/car-details-view/SC87241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_3cd5aef5e47f6529a4537371f0a13359.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_fa454fb5bb1a1326d5f9045611f324a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fa454fb5bb1a1326d5f9045611f324a0.jpg not downloaded yet
2025-12-05 17:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcca50>
2025-12-05 17:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_b6cd65e3e61f9242b0ea729a51d39d6b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b6cd65e3e61f9242b0ea729a51d39d6b.jpg saved to cache
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_b7fc3bdc68f387bb53503ff0a6ea42af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_b7fc3bdc68f387bb53503ff0a6ea42af.jpg not downloaded yet
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_9d30c9dbe0b9390db682ff0d1bd1167c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_fb9baacc53bdca573fd91961c2982416.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fb9baacc53bdca573fd91961c2982416.jpg not downloaded yet
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690aee710>
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_e7df07327070a93c8f226f19096232db.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e7df07327070a93c8f226f19096232db.jpg saved to cache
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe9e50>
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_c4a4b200cfa62dec3a9091859cae8a42.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_c4a4b200cfa62dec3a9091859cae8a42.jpg saved to cache
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 329c5aff-5a4e-540a-9734-a70830ca9fce with identifier: SC87241
2025-12-05 17:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329c5aff-5a4e-540a-9734-a70830ca9fce with scrape type 1
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_f62b9ff93bf08fc00459927fe8a017b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_f62b9ff93bf08fc00459927fe8a017b5.jpg not downloaded yet
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc1f0d0>
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_3cd5aef5e47f6529a4537371f0a13359.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_3cd5aef5e47f6529a4537371f0a13359.jpg saved to cache
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e8d5bd4bd86e5e0a801b39d3b3062777.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_092b513a631e3d65d47740ca765bea46.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_05dcc2a06bcfe7fdd9ad7a6ffe359a70.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_05dcc2a06bcfe7fdd9ad7a6ffe359a70.jpg not downloaded yet
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_7c1c9382c44c1aab747e11d2b2d6d967.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7c1c9382c44c1aab747e11d2b2d6d967.jpg not downloaded yet
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX42113> (referer: https://www.auto1.com/v1/car-details-view/GX42113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da72cd0>
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_9d30c9dbe0b9390db682ff0d1bd1167c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_9d30c9dbe0b9390db682ff0d1bd1167c.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_b7fc3bdc68f387bb53503ff0a6ea42af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_8c6cc0325b39497802a71c0c5616143e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_8c6cc0325b39497802a71c0c5616143e.jpg not downloaded yet
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_4ed0d7d251696c69192ecf18fdbb5143.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4ed0d7d251696c69192ecf18fdbb5143.jpg not downloaded yet
2025-12-05 17:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fb9baacc53bdca573fd91961c2982416.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_f62b9ff93bf08fc00459927fe8a017b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_f179ba2cc1e13b78655c112476d8b866.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_f179ba2cc1e13b78655c112476d8b866.jpg not downloaded yet
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_d5dc32bfbc3ea64831c0180c078c1f82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d5dc32bfbc3ea64831c0180c078c1f82.jpg not downloaded yet
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cfc10>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_e8d5bd4bd86e5e0a801b39d3b3062777.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e8d5bd4bd86e5e0a801b39d3b3062777.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da35090>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_092b513a631e3d65d47740ca765bea46.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_092b513a631e3d65d47740ca765bea46.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1da148-8172-586a-a79b-d869da9ca174 with identifier: GX42113
2025-12-05 17:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1da148-8172-586a-a79b-d869da9ca174 with scrape type 1
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_f6f0ae604fa1860b993c4a8e91711818.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_f6f0ae604fa1860b993c4a8e91711818.jpg not downloaded yet
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_eeb5eff4ce3e6a7050c645aa66cee516.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_eeb5eff4ce3e6a7050c645aa66cee516.jpg not downloaded yet
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_42f8b4ab0463fec61087099bf88ab8e3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_42f8b4ab0463fec61087099bf88ab8e3.jpg not downloaded yet
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_05dcc2a06bcfe7fdd9ad7a6ffe359a70.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7c1c9382c44c1aab747e11d2b2d6d967.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_44b7e36e972dd7f16bb629fc6d72891b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_44b7e36e972dd7f16bb629fc6d72891b.jpg not downloaded yet
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4ed0d7d251696c69192ecf18fdbb5143.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_ca8d22fe69a67ee5e5cd03faf4767d9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_ca8d22fe69a67ee5e5cd03faf4767d9b.jpg not downloaded yet
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE49879> (referer: https://www.auto1.com/v1/car-details-view/ZE49879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_8c6cc0325b39497802a71c0c5616143e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_2bb71bcf4521d4915836e113ed1df56e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_2bb71bcf4521d4915836e113ed1df56e.jpg not downloaded yet
2025-12-05 17:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e606050>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_b7fc3bdc68f387bb53503ff0a6ea42af.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_b7fc3bdc68f387bb53503ff0a6ea42af.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e510d50>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_fb9baacc53bdca573fd91961c2982416.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fb9baacc53bdca573fd91961c2982416.jpg saved to cache
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8d1350>
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_f62b9ff93bf08fc00459927fe8a017b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_f62b9ff93bf08fc00459927fe8a017b5.jpg saved to cache
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_7ef2dd9b631bc778a555d46077e799fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7ef2dd9b631bc778a555d46077e799fd.jpg not downloaded yet
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_f6f0ae604fa1860b993c4a8e91711818.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d5dc32bfbc3ea64831c0180c078c1f82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_3a8ae71382747f56f0931f558c8ba16d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_3a8ae71382747f56f0931f558c8ba16d.jpg not downloaded yet
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_7638aee721fa34e79a65a66d0058153b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7638aee721fa34e79a65a66d0058153b.jpg not downloaded yet
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH84228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS77916> (referer: https://www.auto1.com/v1/car-details-view/RS77916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA62489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74ed90>
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_05dcc2a06bcfe7fdd9ad7a6ffe359a70.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_05dcc2a06bcfe7fdd9ad7a6ffe359a70.jpg saved to cache
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5bdb90>
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_7c1c9382c44c1aab747e11d2b2d6d967.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7c1c9382c44c1aab747e11d2b2d6d967.jpg saved to cache
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9d5850>
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_4ed0d7d251696c69192ecf18fdbb5143.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4ed0d7d251696c69192ecf18fdbb5143.jpg saved to cache
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d65e7df-36bb-507f-855f-a8a036748810 with identifier: ZE49879
2025-12-05 17:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d65e7df-36bb-507f-855f-a8a036748810 with scrape type 2
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d65e7df-36bb-507f-855f-a8a036748810 with scrape type 2
2025-12-05 17:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d65e7df-36bb-507f-855f-a8a036748810, identifier: ZE49879
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690aedcd0>
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_8c6cc0325b39497802a71c0c5616143e.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_8c6cc0325b39497802a71c0c5616143e.jpg saved to cache
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_42f8b4ab0463fec61087099bf88ab8e3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_ce4e4b5a1866127d094e81cd65c19cd0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_ce4e4b5a1866127d094e81cd65c19cd0.jpg not downloaded yet
2025-12-05 17:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d65e7df-36bb-507f-855f-a8a036748810 with identifier: ZE49879
2025-12-05 17:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d65e7df-36bb-507f-855f-a8a036748810 with identifier: ZE49879
2025-12-05 17:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d65e7df-36bb-507f-855f-a8a036748810 with identifier: ZE49879 to the API
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE49879>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:46:04Z',
 'fuel_type': 'hybrid',
 'id': '0d65e7df-36bb-507f-855f-a8a036748810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE49879',
 'listing': 'auction',
 'location': 'ES, Calonge de Segarra, Spain',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 41647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE49879%27 HTTP/1.1" 200 None
2025-12-05 17:08:37 [auto1.es] INFO: Saving data for ZE49879: {'auction_closing_time': 1765039564.0, 'created_time': 1763658541.139658, 'last_price_update_time': 1764954517.08856}
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE49879') HTTP/1.1" 204 0
2025-12-05 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_eeb5eff4ce3e6a7050c645aa66cee516.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_44b7e36e972dd7f16bb629fc6d72891b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_d7e1be7938f366f17f1e6fc8fe5c97bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d7e1be7938f366f17f1e6fc8fe5c97bd.jpg not downloaded yet
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_0963040d237bbe99425b5d6dd4b9c4a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_0963040d237bbe99425b5d6dd4b9c4a4.jpg not downloaded yet
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47fb90>
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_f6f0ae604fa1860b993c4a8e91711818.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_f6f0ae604fa1860b993c4a8e91711818.jpg saved to cache
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbeb210>
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_d5dc32bfbc3ea64831c0180c078c1f82.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d5dc32bfbc3ea64831c0180c078c1f82.jpg saved to cache
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d with identifier: RS77916
2025-12-05 17:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d with scrape type 2
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d with scrape type 2
2025-12-05 17:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d, identifier: RS77916
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_3994ba09787076c2760fde0a3234c5f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_3994ba09787076c2760fde0a3234c5f6.jpg not downloaded yet
2025-12-05 17:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d with identifier: RS77916
2025-12-05 17:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d with identifier: RS77916
2025-12-05 17:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163478 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163478
2025-12-05 17:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d spider: auto1.es
2025-12-05 17:08:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 54a210bd-ca6e-53d8-8c99-f74fc4a7b88d due to rule: high_mileage_for_country.json, error: 163478 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163478
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 340,
 'expiration_date': '2025-12-06T16:39:13Z',
 'fuel_type': 'petrol',
 'id': '54a210bd-ca6e-53d8-8c99-f74fc4a7b88d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS77916',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Audi',
 'model': 'RS Q3',
 'odometer': 163478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS Q3 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS77916%27 HTTP/1.1" 200 None
2025-12-05 17:08:38 [auto1.es] INFO: Saving data for RS77916: {'auction_closing_time': 1765039153.0, 'created_time': 1763445675.37446, 'last_price_update_time': 1764954518.025224}
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RS77916') HTTP/1.1" 204 0
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_2bb71bcf4521d4915836e113ed1df56e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7ef2dd9b631bc778a555d46077e799fd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fa454fb5bb1a1326d5f9045611f324a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_ca8d22fe69a67ee5e5cd03faf4767d9b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_3a8ae71382747f56f0931f558c8ba16d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_f179ba2cc1e13b78655c112476d8b866.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_de82a4abbc6b5b05748ca3fcafc5a4b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_de82a4abbc6b5b05748ca3fcafc5a4b7.jpg not downloaded yet
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5857d0>
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_42f8b4ab0463fec61087099bf88ab8e3.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_42f8b4ab0463fec61087099bf88ab8e3.jpg saved to cache
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7638aee721fa34e79a65a66d0058153b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0e2c8871937159f41d46ba55f6cda93f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_9a5e8c0a607bbe039416ec7faf38df21.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_9a5e8c0a607bbe039416ec7faf38df21.jpg not downloaded yet
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK10680> (referer: https://www.auto1.com/v1/car-details-view/LK10680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_38d689b3a050d3e47223891c451903a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_38d689b3a050d3e47223891c451903a2.jpg not downloaded yet
2025-12-05 17:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fe350>
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_eeb5eff4ce3e6a7050c645aa66cee516.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_eeb5eff4ce3e6a7050c645aa66cee516.jpg saved to cache
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c4ad0>
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_44b7e36e972dd7f16bb629fc6d72891b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_44b7e36e972dd7f16bb629fc6d72891b.jpg saved to cache
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_4e41c7477dbe61f4fd3d16e66b4b776d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4e41c7477dbe61f4fd3d16e66b4b776d.jpg not downloaded yet
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY64818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb0c10>
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_2bb71bcf4521d4915836e113ed1df56e.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_2bb71bcf4521d4915836e113ed1df56e.jpg saved to cache
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8e2750>
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_7ef2dd9b631bc778a555d46077e799fd.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7ef2dd9b631bc778a555d46077e799fd.jpg saved to cache
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e51abd0>
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_fa454fb5bb1a1326d5f9045611f324a0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fa454fb5bb1a1326d5f9045611f324a0.jpg saved to cache
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb1810>
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_ca8d22fe69a67ee5e5cd03faf4767d9b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_ca8d22fe69a67ee5e5cd03faf4767d9b.jpg saved to cache
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dab5ad0>
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_3a8ae71382747f56f0931f558c8ba16d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_3a8ae71382747f56f0931f558c8ba16d.jpg saved to cache
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da3ee50>
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F88%252F928879e25cd3dab8f9a62de5dcf9115a%252Fpa%252FNW34811_f179ba2cc1e13b78655c112476d8b866.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_f179ba2cc1e13b78655c112476d8b866.jpg saved to cache
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0e353615-b792-5fec-87de-37aba0684abc
2025-12-05 17:08:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e353615-b792-5fec-87de-37aba0684abc, skipping ID generation
2025-12-05 17:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e353615-b792-5fec-87de-37aba0684abc with scrape type 1
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0e353615-b792-5fec-87de-37aba0684abc from tracking dictionaries
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e353615-b792-5fec-87de-37aba0684abc sending to next pipeline
2025-12-05 17:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e353615-b792-5fec-87de-37aba0684abc, identifier: NW34811
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_ce4e4b5a1866127d094e81cd65c19cd0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ef9e17efc023357d5705b36a5a4e09b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d7e1be7938f366f17f1e6fc8fe5c97bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_0963040d237bbe99425b5d6dd4b9c4a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_1ddfd50d503f39efd05e351f022d7d11.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_1ddfd50d503f39efd05e351f022d7d11.jpg not downloaded yet
2025-12-05 17:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e353615-b792-5fec-87de-37aba0684abc with identifier: NW34811
2025-12-05 17:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e353615-b792-5fec-87de-37aba0684abc with identifier: NW34811
2025-12-05 17:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e353615-b792-5fec-87de-37aba0684abc with identifier: NW34811 to the API
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_f179ba2cc1e13b78655c112476d8b866.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:36:59Z',
 'fuel_type': 'petrol',
 'id': '0e353615-b792-5fec-87de-37aba0684abc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW34811',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 41759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33187,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e7df07327070a93c8f226f19096232db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33187,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_c4a4b200cfa62dec3a9091859cae8a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28945,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_092b513a631e3d65d47740ca765bea46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28945,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_9d30c9dbe0b9390db682ff0d1bd1167c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32788,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_e8d5bd4bd86e5e0a801b39d3b3062777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32788,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fa454fb5bb1a1326d5f9045611f324a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31024,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_b7fc3bdc68f387bb53503ff0a6ea42af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31024,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_fb9baacc53bdca573fd91961c2982416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62315,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_05dcc2a06bcfe7fdd9ad7a6ffe359a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62315,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_8c6cc0325b39497802a71c0c5616143e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35110,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_f179ba2cc1e13b78655c112476d8b866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e353615-b792-5fec-87de-37aba0684abc/0e353615-b792-5fec-87de-37aba0684abc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63336,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img92/88/928879e25cd3dab8f9a62de5dcf9115a/pa/NW34811_eeb5eff4ce3e6a7050c645aa66cee516.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'automatic',
 'trim': 'Concept',
 'year': 2022}
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW34811%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [auto1.es] INFO: Saving data for NW34811: {'created_time': 1764954520.818398, 'last_price_update_time': 1764954520.818407, 'auction_closing_time': 1765039019.0}
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW34811') HTTP/1.1" 204 0
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_868b3b3692bccc081a8eb8b5602201d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_3994ba09787076c2760fde0a3234c5f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg not downloaded yet
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM18367> (referer: https://www.auto1.com/v1/car-details-view/CM18367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND76145> (referer: https://www.auto1.com/v1/car-details-view/ND76145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71d290>
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_7638aee721fa34e79a65a66d0058153b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7638aee721fa34e79a65a66d0058153b.jpg saved to cache
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da2b1d0>
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_0e2c8871937159f41d46ba55f6cda93f.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0e2c8871937159f41d46ba55f6cda93f.jpg saved to cache
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 with identifier: LK10680
2025-12-05 17:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 with scrape type 1
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_68cb91de5c28fc1549532422a6c5a171.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_68cb91de5c28fc1549532422a6c5a171.jpg not downloaded yet
2025-12-05 17:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_de82a4abbc6b5b05748ca3fcafc5a4b7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_e70a14c67c8eccb0a6b19be35b4680ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_e70a14c67c8eccb0a6b19be35b4680ea.jpg not downloaded yet
2025-12-05 17:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM01709/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_42f9ee1580ea7af0600f7b2212ed4460.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_42f9ee1580ea7af0600f7b2212ed4460.jpg not downloaded yet
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da73b10>
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_ce4e4b5a1866127d094e81cd65c19cd0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_ce4e4b5a1866127d094e81cd65c19cd0.jpg saved to cache
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e584250>
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_ef9e17efc023357d5705b36a5a4e09b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ef9e17efc023357d5705b36a5a4e09b6.jpg saved to cache
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5fefd0>
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_d7e1be7938f366f17f1e6fc8fe5c97bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d7e1be7938f366f17f1e6fc8fe5c97bd.jpg saved to cache
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc2610>
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_0963040d237bbe99425b5d6dd4b9c4a4.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_0963040d237bbe99425b5d6dd4b9c4a4.jpg saved to cache
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_fea921dca95d3b680c0e418dce16869d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_fea921dca95d3b680c0e418dce16869d.jpg not downloaded yet
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da70250>
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_868b3b3692bccc081a8eb8b5602201d6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_868b3b3692bccc081a8eb8b5602201d6.jpg saved to cache
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9f2e50>
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_3994ba09787076c2760fde0a3234c5f6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_3994ba09787076c2760fde0a3234c5f6.jpg saved to cache
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e531df7-571a-5cbc-9d04-05b39ec4a141 with identifier: CM18367
2025-12-05 17:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e531df7-571a-5cbc-9d04-05b39ec4a141 with scrape type 2
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e531df7-571a-5cbc-9d04-05b39ec4a141 with scrape type 2
2025-12-05 17:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e531df7-571a-5cbc-9d04-05b39ec4a141, identifier: CM18367
2025-12-05 17:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75f0115a-af6c-5cae-9777-aea4dc43e00c with identifier: ND76145
2025-12-05 17:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75f0115a-af6c-5cae-9777-aea4dc43e00c with scrape type 1
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_aa5b5c1cc103e17c7a948559f39e7312.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_aa5b5c1cc103e17c7a948559f39e7312.jpg not downloaded yet
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_38d689b3a050d3e47223891c451903a2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_bff59c75310eaaf169744ed2900616d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_487c392c12751493f04545805b2ee18a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_9a5e8c0a607bbe039416ec7faf38df21.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d057ba36bef953a9b195b73da94895d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4e41c7477dbe61f4fd3d16e66b4b776d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_ad7f2901425de1b120e65c8fc4c3c0f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_ad7f2901425de1b120e65c8fc4c3c0f2.jpg not downloaded yet
2025-12-05 17:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e531df7-571a-5cbc-9d04-05b39ec4a141 with identifier: CM18367
2025-12-05 17:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e531df7-571a-5cbc-9d04-05b39ec4a141 with identifier: CM18367
2025-12-05 17:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e531df7-571a-5cbc-9d04-05b39ec4a141 with identifier: CM18367 to the API
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CM18367>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:11:55Z',
 'fuel_type': 'petrol',
 'id': '4e531df7-571a-5cbc-9d04-05b39ec4a141',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM18367',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 44028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2019}
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM18367%27 HTTP/1.1" 200 None
2025-12-05 17:08:43 [auto1.es] INFO: Saving data for CM18367: {'auction_closing_time': 1765037515.0, 'created_time': 1762260572.601696, 'last_price_update_time': 1764954523.191045}
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CM18367') HTTP/1.1" 204 0
2025-12-05 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_1ddfd50d503f39efd05e351f022d7d11.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_af336593771ae3d1ad75dba5ed7ee566.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_af336593771ae3d1ad75dba5ed7ee566.jpg not downloaded yet
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_97c8590ab9dd6aa7706537a483beb98c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_97c8590ab9dd6aa7706537a483beb98c.jpg not downloaded yet
2025-12-05 17:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d996990>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_de82a4abbc6b5b05748ca3fcafc5a4b7.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_de82a4abbc6b5b05748ca3fcafc5a4b7.jpg saved to cache
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_495098f2d90763b7de3026bb3c91bb70.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_495098f2d90763b7de3026bb3c91bb70.jpg not downloaded yet
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_d4b5b504a0c9c23d6cfb11e0ad469f48.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d4b5b504a0c9c23d6cfb11e0ad469f48.jpg not downloaded yet
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e766250>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_38d689b3a050d3e47223891c451903a2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_38d689b3a050d3e47223891c451903a2.jpg saved to cache
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c1590>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_bff59c75310eaaf169744ed2900616d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_bff59c75310eaaf169744ed2900616d2.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e56add0>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_487c392c12751493f04545805b2ee18a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_487c392c12751493f04545805b2ee18a.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7c5190>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fee%252Fcaee8e97bb9f76e25772775cbc8807d9%252Fpa%252FDE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45624cdd-c209-5b62-82e2-d303a80525c2
2025-12-05 17:08:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45624cdd-c209-5b62-82e2-d303a80525c2, skipping ID generation
2025-12-05 17:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45624cdd-c209-5b62-82e2-d303a80525c2 with scrape type 1
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 45624cdd-c209-5b62-82e2-d303a80525c2 from tracking dictionaries
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45624cdd-c209-5b62-82e2-d303a80525c2 sending to next pipeline
2025-12-05 17:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45624cdd-c209-5b62-82e2-d303a80525c2, identifier: DE51179
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7ba390>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_9a5e8c0a607bbe039416ec7faf38df21.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_9a5e8c0a607bbe039416ec7faf38df21.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c11d0>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_d057ba36bef953a9b195b73da94895d6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d057ba36bef953a9b195b73da94895d6.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db79850>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_4e41c7477dbe61f4fd3d16e66b4b776d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4e41c7477dbe61f4fd3d16e66b4b776d.jpg saved to cache
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2b9047e9d6276165a6be80865609effe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_af427be925896a9a84e1901b6386cfa0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_af427be925896a9a84e1901b6386cfa0.jpg not downloaded yet
2025-12-05 17:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179
2025-12-05 17:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179
2025-12-05 17:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179 to the API
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:45:26Z',
 'fuel_type': 'diesel',
 'id': '45624cdd-c209-5b62-82e2-d303a80525c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE51179',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 73865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36217,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_487c392c12751493f04545805b2ee18a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36081,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_04c40e1d5ae3b52b27552f286926c7ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34772,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_bff59c75310eaaf169744ed2900616d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34495,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_868b3b3692bccc081a8eb8b5602201d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36451,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ef9e17efc023357d5705b36a5a4e09b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36217,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0e2c8871937159f41d46ba55f6cda93f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34772,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_210cb136b340f915277c62f75eb879c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36217,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_3cd5aef5e47f6529a4537371f0a13359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44427,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b6cd65e3e61f9242b0ea729a51d39d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36217,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_b94dc9576f77895a111dc960108d3098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63439,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_ed29b56797614b15c1025fc819073471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59759,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_0691663c41d25291ecfa18581b1a87a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45624cdd-c209-5b62-82e2-d303a80525c2/45624cdd-c209-5b62-82e2-d303a80525c2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77992,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ee/caee8e97bb9f76e25772775cbc8807d9/pa/DE51179_df60330efc371f6d7c0cc793b6a542ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51179%27 HTTP/1.1" 200 None
2025-12-05 17:08:45 [auto1.es] INFO: Saving data for DE51179: {'created_time': 1764954525.605312, 'last_price_update_time': 1764954525.605323, 'auction_closing_time': 1765039526.0}
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE51179') HTTP/1.1" 204 0
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a7bd0>
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_1ddfd50d503f39efd05e351f022d7d11.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_1ddfd50d503f39efd05e351f022d7d11.jpg saved to cache
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_68cb91de5c28fc1549532422a6c5a171.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_42f9ee1580ea7af0600f7b2212ed4460.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_aa5b5c1cc103e17c7a948559f39e7312.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_fea921dca95d3b680c0e418dce16869d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f2e98395870f158ee0ffbfea1eb77f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_e70a14c67c8eccb0a6b19be35b4680ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_91cf505472e03405c25b989852b225d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_91cf505472e03405c25b989852b225d0.jpg not downloaded yet
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_f438966d99757205b543f1da2ce9b502.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_f438966d99757205b543f1da2ce9b502.jpg not downloaded yet
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT67329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_a4bcd780b30925568fb7f8164ef80763.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4bcd780b30925568fb7f8164ef80763.jpg not downloaded yet
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_3791b5b6c062b929a69afa4f452da3ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_3791b5b6c062b929a69afa4f452da3ab.jpg not downloaded yet
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6acc90>
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_2b9047e9d6276165a6be80865609effe.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2b9047e9d6276165a6be80865609effe.jpg saved to cache
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d9fe8a746105def351a9383f08417f66.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_561e3da67095029d64bb825ed7bd8c76.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_561e3da67095029d64bb825ed7bd8c76.jpg not downloaded yet
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_495098f2d90763b7de3026bb3c91bb70.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d4b5b504a0c9c23d6cfb11e0ad469f48.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_97c8590ab9dd6aa7706537a483beb98c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_af427be925896a9a84e1901b6386cfa0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_af336593771ae3d1ad75dba5ed7ee566.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_ad7f2901425de1b120e65c8fc4c3c0f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_83aceecc315939ab4444591b1038faa1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_32021fca3bad922ca976b9741d8073d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_32021fca3bad922ca976b9741d8073d5.jpg not downloaded yet
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_8b7b65ad44ec68f009c704fae8e6f070.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_8b7b65ad44ec68f009c704fae8e6f070.jpg not downloaded yet
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_180064009c213cb5d3a9506aa3899f35.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_180064009c213cb5d3a9506aa3899f35.jpg not downloaded yet
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_4b554ac7917c0a6c36a2994b400af5b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_4b554ac7917c0a6c36a2994b400af5b2.jpg not downloaded yet
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d86f410>
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_68cb91de5c28fc1549532422a6c5a171.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_68cb91de5c28fc1549532422a6c5a171.jpg saved to cache
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8a1cd0>
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_42f9ee1580ea7af0600f7b2212ed4460.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_42f9ee1580ea7af0600f7b2212ed4460.jpg saved to cache
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e68a6d0>
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_aa5b5c1cc103e17c7a948559f39e7312.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_aa5b5c1cc103e17c7a948559f39e7312.jpg saved to cache
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e580ed0>
2025-12-05 17:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F74%252F96740a00cc803c0e6d9c0f5e108e9b99%252Fpa%252FSC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg saved to cache
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 329c5aff-5a4e-540a-9734-a70830ca9fce
2025-12-05 17:08:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 329c5aff-5a4e-540a-9734-a70830ca9fce, skipping ID generation
2025-12-05 17:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329c5aff-5a4e-540a-9734-a70830ca9fce with scrape type 1
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 329c5aff-5a4e-540a-9734-a70830ca9fce from tracking dictionaries
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 329c5aff-5a4e-540a-9734-a70830ca9fce sending to next pipeline
2025-12-05 17:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 329c5aff-5a4e-540a-9734-a70830ca9fce, identifier: SC87241
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6690629950>
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_fea921dca95d3b680c0e418dce16869d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_fea921dca95d3b680c0e418dce16869d.jpg saved to cache
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbcd8d0>
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_3f2e98395870f158ee0ffbfea1eb77f1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f2e98395870f158ee0ffbfea1eb77f1.jpg saved to cache
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d86ded0>
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_e70a14c67c8eccb0a6b19be35b4680ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_e70a14c67c8eccb0a6b19be35b4680ea.jpg saved to cache
2025-12-05 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_91cf505472e03405c25b989852b225d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_e3a68aa89e977f0396a18ff08b69ba4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_e3a68aa89e977f0396a18ff08b69ba4d.jpg not downloaded yet
2025-12-05 17:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 329c5aff-5a4e-540a-9734-a70830ca9fce with identifier: SC87241
2025-12-05 17:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 329c5aff-5a4e-540a-9734-a70830ca9fce with identifier: SC87241
2025-12-05 17:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 329c5aff-5a4e-540a-9734-a70830ca9fce with identifier: SC87241 to the API
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 117,
 'expiration_date': '2025-12-06T16:33:55Z',
 'fuel_type': 'petrol',
 'id': '329c5aff-5a4e-540a-9734-a70830ca9fce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC87241',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 47907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31815,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_f62b9ff93bf08fc00459927fe8a017b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31815,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7c1c9382c44c1aab747e11d2b2d6d967.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30906,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4ed0d7d251696c69192ecf18fdbb5143.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30906,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d5dc32bfbc3ea64831c0180c078c1f82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36552,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_42f8b4ab0463fec61087099bf88ab8e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34350,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_ca8d22fe69a67ee5e5cd03faf4767d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34350,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7ef2dd9b631bc778a555d46077e799fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34350,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_7638aee721fa34e79a65a66d0058153b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51348,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_d7e1be7938f366f17f1e6fc8fe5c97bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59441,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_3994ba09787076c2760fde0a3234c5f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59441,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_9a5e8c0a607bbe039416ec7faf38df21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38991,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_4e41c7477dbe61f4fd3d16e66b4b776d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329c5aff-5a4e-540a-9734-a70830ca9fce/329c5aff-5a4e-540a-9734-a70830ca9fce_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46911,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img96/74/96740a00cc803c0e6d9c0f5e108e9b99/pa/SC87241_0dfa780dacd1a5bb62e78b3983b3513a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2020}
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC87241%27 HTTP/1.1" 200 None
2025-12-05 17:08:48 [auto1.es] INFO: Saving data for SC87241: {'created_time': 1764954528.402996, 'last_price_update_time': 1764954528.403008, 'auction_closing_time': 1765038835.0}
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SC87241') HTTP/1.1" 204 0
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4bcd780b30925568fb7f8164ef80763.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_3791b5b6c062b929a69afa4f452da3ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_f438966d99757205b543f1da2ce9b502.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f3fbb388802894be2a3f16589fae9dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_1bd9d4e431ec66be3351e4572691e973.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_e5a76a28888e00efa4ec64735b33dfc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_0e04d811c7e5d0a44bb8b072365de9a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0e04d811c7e5d0a44bb8b072365de9a1.jpg not downloaded yet
2025-12-05 17:08:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2d1c9814a3e93d5542ee30c324de83cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_69143c45a3e596aec8b7017bd2480276.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_69143c45a3e596aec8b7017bd2480276.jpg not downloaded yet
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA62489> (referer: https://www.auto1.com/v1/car-details-view/AA62489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU54823> (referer: https://www.auto1.com/v1/car-details-view/YU54823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY64818> (referer: https://www.auto1.com/v1/car-details-view/ZY64818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_0d01323406d17021d471451346688e65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0d01323406d17021d471451346688e65.jpg not downloaded yet
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_aba2018c9f9ac24bebe194cc047ebc0e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_aba2018c9f9ac24bebe194cc047ebc0e.jpg not downloaded yet
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9580d0>
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_d9fe8a746105def351a9383f08417f66.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d9fe8a746105def351a9383f08417f66.jpg saved to cache
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e51b210>
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_495098f2d90763b7de3026bb3c91bb70.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_495098f2d90763b7de3026bb3c91bb70.jpg saved to cache
2025-12-05 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48f110>
2025-12-05 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_d4b5b504a0c9c23d6cfb11e0ad469f48.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d4b5b504a0c9c23d6cfb11e0ad469f48.jpg saved to cache
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e825410>
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_97c8590ab9dd6aa7706537a483beb98c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_97c8590ab9dd6aa7706537a483beb98c.jpg saved to cache
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da34950>
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_af427be925896a9a84e1901b6386cfa0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_af427be925896a9a84e1901b6386cfa0.jpg saved to cache
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5efa50>
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fc1%252F00c1667b521ca56fe81aee7f506a46c2%252Fpa%252FGX42113_af336593771ae3d1ad75dba5ed7ee566.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_af336593771ae3d1ad75dba5ed7ee566.jpg saved to cache
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc1da148-8172-586a-a79b-d869da9ca174
2025-12-05 17:08:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc1da148-8172-586a-a79b-d869da9ca174, skipping ID generation
2025-12-05 17:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1da148-8172-586a-a79b-d869da9ca174 with scrape type 1
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc1da148-8172-586a-a79b-d869da9ca174 from tracking dictionaries
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc1da148-8172-586a-a79b-d869da9ca174 sending to next pipeline
2025-12-05 17:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc1da148-8172-586a-a79b-d869da9ca174, identifier: GX42113
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7f1d0>
2025-12-05 17:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_ad7f2901425de1b120e65c8fc4c3c0f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_ad7f2901425de1b120e65c8fc4c3c0f2.jpg saved to cache
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d932d50>
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_83aceecc315939ab4444591b1038faa1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_83aceecc315939ab4444591b1038faa1.jpg saved to cache
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba2850>
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_91cf505472e03405c25b989852b225d0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_91cf505472e03405c25b989852b225d0.jpg saved to cache
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_d9075c78935978734c2d3b833155d06f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d9075c78935978734c2d3b833155d06f.jpg not downloaded yet
2025-12-05 17:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc1da148-8172-586a-a79b-d869da9ca174 with identifier: GX42113
2025-12-05 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc1da148-8172-586a-a79b-d869da9ca174 with identifier: GX42113
2025-12-05 17:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc1da148-8172-586a-a79b-d869da9ca174 with identifier: GX42113 to the API
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_af336593771ae3d1ad75dba5ed7ee566.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:57:26Z',
 'fuel_type': 'petrol',
 'id': 'fc1da148-8172-586a-a79b-d869da9ca174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX42113',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 37879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34852,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_f6f0ae604fa1860b993c4a8e91711818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34852,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_44b7e36e972dd7f16bb629fc6d72891b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29379,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_2bb71bcf4521d4915836e113ed1df56e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29379,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_3a8ae71382747f56f0931f558c8ba16d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33937,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_ce4e4b5a1866127d094e81cd65c19cd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33937,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_0963040d237bbe99425b5d6dd4b9c4a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34615,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_de82a4abbc6b5b05748ca3fcafc5a4b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34615,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_38d689b3a050d3e47223891c451903a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57067,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_1ddfd50d503f39efd05e351f022d7d11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57067,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_e70a14c67c8eccb0a6b19be35b4680ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33893,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_fea921dca95d3b680c0e418dce16869d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1da148-8172-586a-a79b-d869da9ca174/fc1da148-8172-586a-a79b-d869da9ca174_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58471,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img00/c1/00c1667b521ca56fe81aee7f506a46c2/pa/GX42113_af336593771ae3d1ad75dba5ed7ee566.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'automatic',
 'trim': 'Concept',
 'year': 2022}
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX42113%27 HTTP/1.1" 200 None
2025-12-05 17:08:51 [auto1.es] INFO: Saving data for GX42113: {'created_time': 1764954531.002805, 'last_price_update_time': 1764954531.002814, 'auction_closing_time': 1765040246.0}
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GX42113') HTTP/1.1" 204 0
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_561e3da67095029d64bb825ed7bd8c76.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_4b554ac7917c0a6c36a2994b400af5b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_32021fca3bad922ca976b9741d8073d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_180064009c213cb5d3a9506aa3899f35.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_f6c065cc12c82df811e200695adb594a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_9342011aeb028e7f7c805d389e7fc928.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_37afc5853388c185981ccf91728fdf97.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_8b7b65ad44ec68f009c704fae8e6f070.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_4867218ddffffbbdd35c93e1d7205065.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_4867218ddffffbbdd35c93e1d7205065.jpg not downloaded yet
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_a4d167adf8965ee84d03b90eb6b0a2d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4d167adf8965ee84d03b90eb6b0a2d1.jpg not downloaded yet
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU76295> (referer: https://www.auto1.com/v1/car-details-view/SU76295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH84228> (referer: https://www.auto1.com/v1/car-details-view/AH84228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e721790>
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_a4bcd780b30925568fb7f8164ef80763.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4bcd780b30925568fb7f8164ef80763.jpg saved to cache
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e625e90>
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_3791b5b6c062b929a69afa4f452da3ab.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_3791b5b6c062b929a69afa4f452da3ab.jpg saved to cache
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4c6a90>
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_f438966d99757205b543f1da2ce9b502.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_f438966d99757205b543f1da2ce9b502.jpg saved to cache
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c1510>
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_3f3fbb388802894be2a3f16589fae9dd.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f3fbb388802894be2a3f16589fae9dd.jpg saved to cache
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a5ad0>
2025-12-05 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_1bd9d4e431ec66be3351e4572691e973.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_1bd9d4e431ec66be3351e4572691e973.jpg saved to cache
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fc890>
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_e5a76a28888e00efa4ec64735b33dfc6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_e5a76a28888e00efa4ec64735b33dfc6.jpg saved to cache
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b26d0>
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_2d1c9814a3e93d5542ee30c324de83cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2d1c9814a3e93d5542ee30c324de83cb.jpg saved to cache
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e20bab63-05a4-5d55-90d5-259d45169b0e with identifier: AA62489
2025-12-05 17:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e20bab63-05a4-5d55-90d5-259d45169b0e with scrape type 1
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_a623ffc06f9481914ef6b850cd94f10f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a623ffc06f9481914ef6b850cd94f10f.jpg not downloaded yet
2025-12-05 17:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d22b98-9d51-5c60-b59b-fe33bc93799d with identifier: YU54823
2025-12-05 17:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d22b98-9d51-5c60-b59b-fe33bc93799d with scrape type 1
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 83d22b98-9d51-5c60-b59b-fe33bc93799d
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_c48e9ff57b0c1a3591a1c6715bec69cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_c48e9ff57b0c1a3591a1c6715bec69cd.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_eba885815e7464c0460a7407f489301d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_eba885815e7464c0460a7407f489301d.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_2de7cebf8811e51ce9c9c797f03f214d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_2de7cebf8811e51ce9c9c797f03f214d.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_739b183317f6baa3798f01805ea39593.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_739b183317f6baa3798f01805ea39593.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_4cc972e07a97e98e4047d7b4f07fce1c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_4cc972e07a97e98e4047d7b4f07fce1c.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_781ffbe91bd74d503f9349290bbfeee1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_781ffbe91bd74d503f9349290bbfeee1.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_fb096855a81ada9bbace8db7ac24ca71.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_fb096855a81ada9bbace8db7ac24ca71.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_43c70a9cbdbe817535c0f23db747c413.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_43c70a9cbdbe817535c0f23db747c413.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_75a9c10f3b290b3426367a97de3956bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_75a9c10f3b290b3426367a97de3956bb.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_2a80f4c7e892406f6fd46b8db763d6a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_2a80f4c7e892406f6fd46b8db763d6a5.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_f3bec9c437c1130322bf56de16ccd3f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_f3bec9c437c1130322bf56de16ccd3f2.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_64690bd071591eb11e3ac2f17a2a301a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_64690bd071591eb11e3ac2f17a2a301a.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_99f1ec16d802e9a40a9c9b34ad23f378.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_99f1ec16d802e9a40a9c9b34ad23f378.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_e3ac4a945ced8a9adf537c33f608ccfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_e3ac4a945ced8a9adf537c33f608ccfa.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_03db19233a8719bc29f1cf6345f2f722.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_03db19233a8719bc29f1cf6345f2f722.jpg already downloaded
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc0d5c5bd60b23b2ac1589af0d479cb%252Fpa%252FYU54823_9a10bb9d8d8ee4303026accdafcdc9fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_9a10bb9d8d8ee4303026accdafcdc9fb.jpg already downloaded
2025-12-05 17:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83d22b98-9d51-5c60-b59b-fe33bc93799d, identifier: YU54823
2025-12-05 17:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67abc8a-e47b-52c6-ac29-f08d8744df89 with identifier: ZY64818
2025-12-05 17:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67abc8a-e47b-52c6-ac29-f08d8744df89 with scrape type 2
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67abc8a-e47b-52c6-ac29-f08d8744df89 with scrape type 2
2025-12-05 17:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a67abc8a-e47b-52c6-ac29-f08d8744df89, identifier: ZY64818
2025-12-05 17:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83d22b98-9d51-5c60-b59b-fe33bc93799d with identifier: YU54823
2025-12-05 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83d22b98-9d51-5c60-b59b-fe33bc93799d with identifier: YU54823
2025-12-05 17:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83d22b98-9d51-5c60-b59b-fe33bc93799d with identifier: YU54823 to the API
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU54823>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:09:18Z',
 'fuel_type': 'petrol',
 'id': '83d22b98-9d51-5c60-b59b-fe33bc93799d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU54823',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Skoda',
 'model': 'Scala',
 'odometer': 70652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_c48e9ff57b0c1a3591a1c6715bec69cd.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_eba885815e7464c0460a7407f489301d.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_2de7cebf8811e51ce9c9c797f03f214d.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_739b183317f6baa3798f01805ea39593.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_4cc972e07a97e98e4047d7b4f07fce1c.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_781ffbe91bd74d503f9349290bbfeee1.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_fb096855a81ada9bbace8db7ac24ca71.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_43c70a9cbdbe817535c0f23db747c413.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_75a9c10f3b290b3426367a97de3956bb.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_2a80f4c7e892406f6fd46b8db763d6a5.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_f3bec9c437c1130322bf56de16ccd3f2.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_64690bd071591eb11e3ac2f17a2a301a.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_99f1ec16d802e9a40a9c9b34ad23f378.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_e3ac4a945ced8a9adf537c33f608ccfa.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_03db19233a8719bc29f1cf6345f2f722.jpg',
                'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_9a10bb9d8d8ee4303026accdafcdc9fb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_c48e9ff57b0c1a3591a1c6715bec69cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_eba885815e7464c0460a7407f489301d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_2de7cebf8811e51ce9c9c797f03f214d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_739b183317f6baa3798f01805ea39593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_4cc972e07a97e98e4047d7b4f07fce1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_781ffbe91bd74d503f9349290bbfeee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_fb096855a81ada9bbace8db7ac24ca71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_43c70a9cbdbe817535c0f23db747c413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_75a9c10f3b290b3426367a97de3956bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_2a80f4c7e892406f6fd46b8db763d6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_f3bec9c437c1130322bf56de16ccd3f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_64690bd071591eb11e3ac2f17a2a301a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_99f1ec16d802e9a40a9c9b34ad23f378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_e3ac4a945ced8a9adf537c33f608ccfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_03db19233a8719bc29f1cf6345f2f722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d22b98-9d51-5c60-b59b-fe33bc93799d/83d22b98-9d51-5c60-b59b-fe33bc93799d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc0d5c5bd60b23b2ac1589af0d479cb/pa/YU54823_9a10bb9d8d8ee4303026accdafcdc9fb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Scala 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU54823%27 HTTP/1.1" 200 None
2025-12-05 17:08:53 [auto1.es] INFO: Saving data for YU54823: {'created_time': 1764954533.453617, 'last_price_update_time': 1764954533.453627, 'auction_closing_time': 1765037358.0}
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU54823') HTTP/1.1" 204 0
2025-12-05 17:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a67abc8a-e47b-52c6-ac29-f08d8744df89 with identifier: ZY64818
2025-12-05 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a67abc8a-e47b-52c6-ac29-f08d8744df89 with identifier: ZY64818
2025-12-05 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a67abc8a-e47b-52c6-ac29-f08d8744df89 spider: auto1.es
2025-12-05 17:08:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a67abc8a-e47b-52c6-ac29-f08d8744df89 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:28:38Z',
 'fuel_type': 'diesel',
 'id': 'a67abc8a-e47b-52c6-ac29-f08d8744df89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY64818',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 70167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2022}
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY64818%27 HTTP/1.1" 200 None
2025-12-05 17:08:53 [auto1.es] INFO: Saving data for ZY64818: {'auction_closing_time': 1765038518.0, 'created_time': 1764003764.858942, 'last_price_update_time': 1764954533.674531}
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY64818') HTTP/1.1" 204 0
2025-12-05 17:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_d14778c586f5507d322c14e9d1a39ea7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d14778c586f5507d322c14e9d1a39ea7.jpg not downloaded yet
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_25eaa9cfec51820d1015c4059bcbf008.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_25eaa9cfec51820d1015c4059bcbf008.jpg not downloaded yet
2025-12-05 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0e04d811c7e5d0a44bb8b072365de9a1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_e3a68aa89e977f0396a18ff08b69ba4d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_69143c45a3e596aec8b7017bd2480276.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_cb81817febbcb0d22b2f3cc54e88c847.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9c3910>
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_561e3da67095029d64bb825ed7bd8c76.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_561e3da67095029d64bb825ed7bd8c76.jpg saved to cache
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9055d0>
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_4b554ac7917c0a6c36a2994b400af5b2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_4b554ac7917c0a6c36a2994b400af5b2.jpg saved to cache
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ef3d0>
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_32021fca3bad922ca976b9741d8073d5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_32021fca3bad922ca976b9741d8073d5.jpg saved to cache
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e75d950>
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_180064009c213cb5d3a9506aa3899f35.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_180064009c213cb5d3a9506aa3899f35.jpg saved to cache
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e75de10>
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_f6c065cc12c82df811e200695adb594a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_f6c065cc12c82df811e200695adb594a.jpg saved to cache
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5c6050>
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_9342011aeb028e7f7c805d389e7fc928.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_9342011aeb028e7f7c805d389e7fc928.jpg saved to cache
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a2a90>
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_37afc5853388c185981ccf91728fdf97.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_37afc5853388c185981ccf91728fdf97.jpg saved to cache
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d859390>
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_8b7b65ad44ec68f009c704fae8e6f070.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_8b7b65ad44ec68f009c704fae8e6f070.jpg saved to cache
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2141f0-e446-56ba-ab60-abd2b1010560 with identifier: SU76295
2025-12-05 17:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2141f0-e446-56ba-ab60-abd2b1010560 with scrape type 1
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_3e833ff2e311b905d4fb456f2acc3926.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_3e833ff2e311b905d4fb456f2acc3926.jpg not downloaded yet
2025-12-05 17:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd with identifier: AH84228
2025-12-05 17:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd with scrape type 1
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_53492a4ae1ce718fd690d706a38a7246.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_53492a4ae1ce718fd690d706a38a7246.jpg not downloaded yet
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0d01323406d17021d471451346688e65.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_29cea061f87019158c26c53bf9c9777c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_aba2018c9f9ac24bebe194cc047ebc0e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d9075c78935978734c2d3b833155d06f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_2046a985e4ca7978306e4bd96cfcbb4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_2046a985e4ca7978306e4bd96cfcbb4c.jpg not downloaded yet
2025-12-05 17:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_7bbda5bda765cfc27080e71b42b9e51b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_7bbda5bda765cfc27080e71b42b9e51b.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_127be59a0dee9777e63a92f8b01ea3de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_127be59a0dee9777e63a92f8b01ea3de.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_70038ae73fa9402a32cbd77f5f4c0ee3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_70038ae73fa9402a32cbd77f5f4c0ee3.jpg not downloaded yet
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT67329> (referer: https://www.auto1.com/v1/car-details-view/CT67329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM01709> (referer: https://www.auto1.com/v1/car-details-view/KM01709/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e61a690>
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_0e04d811c7e5d0a44bb8b072365de9a1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0e04d811c7e5d0a44bb8b072365de9a1.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc8050>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_e3a68aa89e977f0396a18ff08b69ba4d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_e3a68aa89e977f0396a18ff08b69ba4d.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e650c90>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_69143c45a3e596aec8b7017bd2480276.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_69143c45a3e596aec8b7017bd2480276.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9e7990>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_cb81817febbcb0d22b2f3cc54e88c847.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_cb81817febbcb0d22b2f3cc54e88c847.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_8149fa7945059e7922bcbb51c6c20433.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4c64af48c12ceca5972cf20de0764b20.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4d167adf8965ee84d03b90eb6b0a2d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_012fec543ed91c546d44125986bceb30.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_012fec543ed91c546d44125986bceb30.jpg not downloaded yet
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_4728d4d45540fd169275913f568e2a03.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_4728d4d45540fd169275913f568e2a03.jpg not downloaded yet
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_25eaa9cfec51820d1015c4059bcbf008.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d14778c586f5507d322c14e9d1a39ea7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_4867218ddffffbbdd35c93e1d7205065.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a623ffc06f9481914ef6b850cd94f10f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_a344caba0a5a576f2da7bd544c71aee9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a344caba0a5a576f2da7bd544c71aee9.jpg not downloaded yet
2025-12-05 17:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6087f73e91f5c9ad2ec876739e630924.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_e3d3ee4aa7f62cb1359d67ca3dc560bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e3d3ee4aa7f62cb1359d67ca3dc560bb.jpg not downloaded yet
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_3e72c00e3c1d9e234bdc51179297f7ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_3e72c00e3c1d9e234bdc51179297f7ec.jpg not downloaded yet
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6fb450>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_0d01323406d17021d471451346688e65.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0d01323406d17021d471451346688e65.jpg saved to cache
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6bd290>
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fa3%252Ffea3db95cc3d7410411f215d83cbdc5c%252Fpa%252FPS87786_29cea061f87019158c26c53bf9c9777c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_29cea061f87019158c26c53bf9c9777c.jpg saved to cache
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6
2025-12-05 17:08:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cada4a85-e1dd-5b0d-9580-92a5d5b5eec6, skipping ID generation
2025-12-05 17:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 with scrape type 1
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 from tracking dictionaries
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 sending to next pipeline
2025-12-05 17:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cada4a85-e1dd-5b0d-9580-92a5d5b5eec6, identifier: PS87786
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ef350>
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_aba2018c9f9ac24bebe194cc047ebc0e.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_aba2018c9f9ac24bebe194cc047ebc0e.jpg saved to cache
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbd8ad0>
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_d9075c78935978734c2d3b833155d06f.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d9075c78935978734c2d3b833155d06f.jpg saved to cache
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c0a81d7-4862-5d6a-8ff6-80787393969f with identifier: CT67329
2025-12-05 17:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c0a81d7-4862-5d6a-8ff6-80787393969f with scrape type 2
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c0a81d7-4862-5d6a-8ff6-80787393969f with scrape type 2
2025-12-05 17:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c0a81d7-4862-5d6a-8ff6-80787393969f, identifier: CT67329
2025-12-05 17:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a with identifier: KM01709
2025-12-05 17:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a with scrape type 2
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a with scrape type 2
2025-12-05 17:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a, identifier: KM01709
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_db496d6b400b5c50acc8ec256d19e0c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_db496d6b400b5c50acc8ec256d19e0c3.jpg not downloaded yet
2025-12-05 17:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 with identifier: PS87786
2025-12-05 17:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 with identifier: PS87786
2025-12-05 17:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cada4a85-e1dd-5b0d-9580-92a5d5b5eec6 with identifier: PS87786 to the API
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_29cea061f87019158c26c53bf9c9777c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:05:10Z',
 'fuel_type': 'petrol',
 'id': 'cada4a85-e1dd-5b0d-9580-92a5d5b5eec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS87786',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 146571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_29cea061f87019158c26c53bf9c9777c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_cb81817febbcb0d22b2f3cc54e88c847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_37afc5853388c185981ccf91728fdf97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_9342011aeb028e7f7c805d389e7fc928.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_f6c065cc12c82df811e200695adb594a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_e5a76a28888e00efa4ec64735b33dfc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f3fbb388802894be2a3f16589fae9dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_1bd9d4e431ec66be3351e4572691e973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2d1c9814a3e93d5542ee30c324de83cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_83aceecc315939ab4444591b1038faa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d9fe8a746105def351a9383f08417f66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_3f2e98395870f158ee0ffbfea1eb77f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_2b9047e9d6276165a6be80865609effe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_d057ba36bef953a9b195b73da94895d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_6c4ff4ab5c6b86f58de065c6a00e657a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cada4a85-e1dd-5b0d-9580-92a5d5b5eec6/cada4a85-e1dd-5b0d-9580-92a5d5b5eec6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a3/fea3db95cc3d7410411f215d83cbdc5c/pa/PS87786_128107c581fbd638f8c4d2d95a69df8a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2019}
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS87786%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [auto1.es] INFO: Saving data for PS87786: {'created_time': 1764954538.581566, 'last_price_update_time': 1764954538.581578, 'auction_closing_time': 1765037110.0}
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS87786') HTTP/1.1" 204 0
2025-12-05 17:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c0a81d7-4862-5d6a-8ff6-80787393969f with identifier: CT67329
2025-12-05 17:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c0a81d7-4862-5d6a-8ff6-80787393969f with identifier: CT67329
2025-12-05 17:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1c0a81d7-4862-5d6a-8ff6-80787393969f spider: auto1.es
2025-12-05 17:08:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1c0a81d7-4862-5d6a-8ff6-80787393969f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:18:33Z',
 'fuel_type': 'diesel',
 'id': '1c0a81d7-4862-5d6a-8ff6-80787393969f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT67329',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 125755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2022}
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT67329%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [auto1.es] INFO: Saving data for CT67329: {'auction_closing_time': 1765037913.0, 'created_time': 1762966973.428272, 'last_price_update_time': 1764954538.813272}
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT67329') HTTP/1.1" 204 0
2025-12-05 17:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a with identifier: KM01709
2025-12-05 17:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a with identifier: KM01709
2025-12-05 17:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 59c08f8e-9b3b-58cd-ae7e-ec338b824d7a with identifier: KM01709 to the API
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM01709>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2025-12-06T16:04:38Z',
 'fuel_type': 'diesel',
 'id': '59c08f8e-9b3b-58cd-ae7e-ec338b824d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM01709',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 102785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D5 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2017}
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM01709%27 HTTP/1.1" 200 None
2025-12-05 17:08:59 [auto1.es] INFO: Saving data for KM01709: {'auction_closing_time': 1765037078.0, 'created_time': 1762840858.087353, 'last_price_update_time': 1764954539.159425}
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KM01709') HTTP/1.1" 204 0
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_7bbda5bda765cfc27080e71b42b9e51b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_3e833ff2e311b905d4fb456f2acc3926.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_53492a4ae1ce718fd690d706a38a7246.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_127be59a0dee9777e63a92f8b01ea3de.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_706443d51a9da53fd0526f288ea2b0b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_706443d51a9da53fd0526f288ea2b0b9.jpg not downloaded yet
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_6c904a093ce452654574e48f95f9392e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_6c904a093ce452654574e48f95f9392e.jpg not downloaded yet
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_70038ae73fa9402a32cbd77f5f4c0ee3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_2046a985e4ca7978306e4bd96cfcbb4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_818263c60802297360e0bb9f6060d8fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_818263c60802297360e0bb9f6060d8fc.jpg not downloaded yet
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_e0d9f550d1518b9ba7518d2f823c6d1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b2f6d9cef6300268eb38522ab21ca538.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_624c3a4e5e8c2cdd76e39461b28e3a9a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_624c3a4e5e8c2cdd76e39461b28e3a9a.jpg not downloaded yet
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_225355a63cd7ccbc9feb3a0ddf0f4ac2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_225355a63cd7ccbc9feb3a0ddf0f4ac2.jpg not downloaded yet
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da8dfd0>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_8149fa7945059e7922bcbb51c6c20433.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_8149fa7945059e7922bcbb51c6c20433.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5ba150>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_4c64af48c12ceca5972cf20de0764b20.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4c64af48c12ceca5972cf20de0764b20.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4ad610>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_a4d167adf8965ee84d03b90eb6b0a2d1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4d167adf8965ee84d03b90eb6b0a2d1.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d96d110>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_25eaa9cfec51820d1015c4059bcbf008.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_25eaa9cfec51820d1015c4059bcbf008.jpg saved to cache
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfbad0>
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F11%252Fd7111ee56cb2878b4ce25a11bcc9d458%252Fpa%252FND76145_d14778c586f5507d322c14e9d1a39ea7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d14778c586f5507d322c14e9d1a39ea7.jpg saved to cache
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 75f0115a-af6c-5cae-9777-aea4dc43e00c
2025-12-05 17:09:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75f0115a-af6c-5cae-9777-aea4dc43e00c, skipping ID generation
2025-12-05 17:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75f0115a-af6c-5cae-9777-aea4dc43e00c with scrape type 1
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 75f0115a-af6c-5cae-9777-aea4dc43e00c from tracking dictionaries
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75f0115a-af6c-5cae-9777-aea4dc43e00c sending to next pipeline
2025-12-05 17:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75f0115a-af6c-5cae-9777-aea4dc43e00c, identifier: ND76145
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6d6810>
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5f%252Fb95f212480828de898f1c51b204cdcd7%252Fpa%252FLK10680_4867218ddffffbbdd35c93e1d7205065.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_4867218ddffffbbdd35c93e1d7205065.jpg saved to cache
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7
2025-12-05 17:09:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fb747ee-bac3-5c2c-b9c6-1e034de143b7, skipping ID generation
2025-12-05 17:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 with scrape type 1
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 from tracking dictionaries
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 sending to next pipeline
2025-12-05 17:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fb747ee-bac3-5c2c-b9c6-1e034de143b7, identifier: LK10680
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6d4b90>
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_a623ffc06f9481914ef6b850cd94f10f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a623ffc06f9481914ef6b850cd94f10f.jpg saved to cache
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54e790>
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_6087f73e91f5c9ad2ec876739e630924.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6087f73e91f5c9ad2ec876739e630924.jpg saved to cache
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_4728d4d45540fd169275913f568e2a03.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_46d5adc7dcd28fd78309d700076ba7ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_46d5adc7dcd28fd78309d700076ba7ec.jpg not downloaded yet
2025-12-05 17:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75f0115a-af6c-5cae-9777-aea4dc43e00c with identifier: ND76145
2025-12-05 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75f0115a-af6c-5cae-9777-aea4dc43e00c with identifier: ND76145
2025-12-05 17:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75f0115a-af6c-5cae-9777-aea4dc43e00c with identifier: ND76145 to the API
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d14778c586f5507d322c14e9d1a39ea7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:44:32Z',
 'fuel_type': 'diesel',
 'id': '75f0115a-af6c-5cae-9777-aea4dc43e00c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND76145',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 79088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36376,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_aa5b5c1cc103e17c7a948559f39e7312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36376,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_97c8590ab9dd6aa7706537a483beb98c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36376,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d4b5b504a0c9c23d6cfb11e0ad469f48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35454,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_91cf505472e03405c25b989852b225d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34391,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4bcd780b30925568fb7f8164ef80763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36376,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_561e3da67095029d64bb825ed7bd8c76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35227,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_8b7b65ad44ec68f009c704fae8e6f070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36376,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_4b554ac7917c0a6c36a2994b400af5b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48189,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0e04d811c7e5d0a44bb8b072365de9a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34391,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_0d01323406d17021d471451346688e65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57667,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d9075c78935978734c2d3b833155d06f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58556,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_a4d167adf8965ee84d03b90eb6b0a2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75f0115a-af6c-5cae-9777-aea4dc43e00c/75f0115a-af6c-5cae-9777-aea4dc43e00c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65606,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/11/d7111ee56cb2878b4ce25a11bcc9d458/pa/ND76145_d14778c586f5507d322c14e9d1a39ea7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND76145%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [auto1.es] INFO: Saving data for ND76145: {'created_time': 1764954542.113773, 'last_price_update_time': 1764954542.113784, 'auction_closing_time': 1765039472.0}
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ND76145') HTTP/1.1" 204 0
2025-12-05 17:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 with identifier: LK10680
2025-12-05 17:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 with identifier: LK10680
2025-12-05 17:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fb747ee-bac3-5c2c-b9c6-1e034de143b7 with identifier: LK10680 to the API
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_4867218ddffffbbdd35c93e1d7205065.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:30:45Z',
 'fuel_type': 'diesel',
 'id': '0fb747ee-bac3-5c2c-b9c6-1e034de143b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK10680',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 84126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39278,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_68cb91de5c28fc1549532422a6c5a171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39186,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_42f9ee1580ea7af0600f7b2212ed4460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37883,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_ad7f2901425de1b120e65c8fc4c3c0f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32252,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_495098f2d90763b7de3026bb3c91bb70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38239,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_af427be925896a9a84e1901b6386cfa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39186,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_f438966d99757205b543f1da2ce9b502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38033,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_3791b5b6c062b929a69afa4f452da3ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39186,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_32021fca3bad922ca976b9741d8073d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53548,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_180064009c213cb5d3a9506aa3899f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39278,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_e3a68aa89e977f0396a18ff08b69ba4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58079,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_69143c45a3e596aec8b7017bd2480276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58319,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_aba2018c9f9ac24bebe194cc047ebc0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb747ee-bac3-5c2c-b9c6-1e034de143b7/0fb747ee-bac3-5c2c-b9c6-1e034de143b7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69176,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/5f/b95f212480828de898f1c51b204cdcd7/pa/LK10680_4867218ddffffbbdd35c93e1d7205065.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK10680%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [auto1.es] INFO: Saving data for LK10680: {'created_time': 1764954542.489776, 'last_price_update_time': 1764954542.489791, 'auction_closing_time': 1765038645.0}
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK10680') HTTP/1.1" 204 0
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e3d3ee4aa7f62cb1359d67ca3dc560bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_012fec543ed91c546d44125986bceb30.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_3e72c00e3c1d9e234bdc51179297f7ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_ed39064f7acbd699dc5834a5a0dfae91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_ed39064f7acbd699dc5834a5a0dfae91.jpg not downloaded yet
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_b4bdcd9c14d637bf8ea40f019ddebb26.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b4bdcd9c14d637bf8ea40f019ddebb26.jpg not downloaded yet
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a344caba0a5a576f2da7bd544c71aee9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_bdc801a7beca8c0f2fcd0aef6bebe618.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_bdc801a7beca8c0f2fcd0aef6bebe618.jpg not downloaded yet
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG40142> (referer: https://www.auto1.com/v1/car-details-view/HG40142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV61138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ09621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e717610>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_7bbda5bda765cfc27080e71b42b9e51b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_7bbda5bda765cfc27080e71b42b9e51b.jpg saved to cache
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061bd90>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_3e833ff2e311b905d4fb456f2acc3926.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_3e833ff2e311b905d4fb456f2acc3926.jpg saved to cache
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da3d250>
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_53492a4ae1ce718fd690d706a38a7246.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_53492a4ae1ce718fd690d706a38a7246.jpg saved to cache
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e763050>
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_127be59a0dee9777e63a92f8b01ea3de.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_127be59a0dee9777e63a92f8b01ea3de.jpg saved to cache
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e668110>
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_70038ae73fa9402a32cbd77f5f4c0ee3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_70038ae73fa9402a32cbd77f5f4c0ee3.jpg saved to cache
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d7cd0>
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_2046a985e4ca7978306e4bd96cfcbb4c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_2046a985e4ca7978306e4bd96cfcbb4c.jpg saved to cache
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54e890>
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_e0d9f550d1518b9ba7518d2f823c6d1e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_e0d9f550d1518b9ba7518d2f823c6d1e.jpg saved to cache
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8aeb50>
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_b2f6d9cef6300268eb38522ab21ca538.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b2f6d9cef6300268eb38522ab21ca538.jpg saved to cache
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_706443d51a9da53fd0526f288ea2b0b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6fb84eee4de8c5e7065c93a697afc664.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_db496d6b400b5c50acc8ec256d19e0c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_33ebb942dd3f58217f53d7316aafb3a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_33ebb942dd3f58217f53d7316aafb3a8.jpg not downloaded yet
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_70be4306a9c44598927cb570a2ba4789.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_70be4306a9c44598927cb570a2ba4789.jpg not downloaded yet
2025-12-05 17:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_6c904a093ce452654574e48f95f9392e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_0f82b57770dd586e3aedcde256faa958.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_0f82b57770dd586e3aedcde256faa958.jpg not downloaded yet
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d91d7d0>
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_4728d4d45540fd169275913f568e2a03.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_4728d4d45540fd169275913f568e2a03.jpg saved to cache
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_818263c60802297360e0bb9f6060d8fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_b5567c162bf8a4dc2dd820090995536e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_b5567c162bf8a4dc2dd820090995536e.jpg not downloaded yet
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_9a04e69cc01ccaba079c5234806c42e3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_9a04e69cc01ccaba079c5234806c42e3.jpg not downloaded yet
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR65471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU53560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY30936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR98659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e66b310>
2025-12-05 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_e3d3ee4aa7f62cb1359d67ca3dc560bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e3d3ee4aa7f62cb1359d67ca3dc560bb.jpg saved to cache
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e54e610>
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_012fec543ed91c546d44125986bceb30.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_012fec543ed91c546d44125986bceb30.jpg saved to cache
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a3150>
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_3e72c00e3c1d9e234bdc51179297f7ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_3e72c00e3c1d9e234bdc51179297f7ec.jpg saved to cache
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db786d0>
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_a344caba0a5a576f2da7bd544c71aee9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a344caba0a5a576f2da7bd544c71aee9.jpg saved to cache
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3701af58-f3db-5e9f-bdb8-258947e2a98b with identifier: HG40142
2025-12-05 17:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3701af58-f3db-5e9f-bdb8-258947e2a98b with scrape type 2
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3701af58-f3db-5e9f-bdb8-258947e2a98b with scrape type 2
2025-12-05 17:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3701af58-f3db-5e9f-bdb8-258947e2a98b, identifier: HG40142
2025-12-05 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_624c3a4e5e8c2cdd76e39461b28e3a9a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_225355a63cd7ccbc9feb3a0ddf0f4ac2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_d5839b88aeb4a514388607776a8d3f20.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d5839b88aeb4a514388607776a8d3f20.jpg not downloaded yet
2025-12-05 17:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3701af58-f3db-5e9f-bdb8-258947e2a98b with identifier: HG40142
2025-12-05 17:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3701af58-f3db-5e9f-bdb8-258947e2a98b with identifier: HG40142
2025-12-05 17:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3701af58-f3db-5e9f-bdb8-258947e2a98b with identifier: HG40142 to the API
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HG40142>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:30:07Z',
 'fuel_type': 'diesel',
 'id': '3701af58-f3db-5e9f-bdb8-258947e2a98b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG40142',
 'listing': 'auction',
 'location': 'ES',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 109431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.5 Blue-HDi Montmartre',
 'transmission': 'manual',
 'trim': 'Montmartre',
 'year': 2022}
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG40142%27 HTTP/1.1" 200 None
2025-12-05 17:09:06 [auto1.es] INFO: Saving data for HG40142: {'auction_closing_time': 1765038607.0, 'created_time': 1760461430.856214, 'last_price_update_time': 1764954546.486719}
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HG40142') HTTP/1.1" 204 0
2025-12-05 17:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b4bdcd9c14d637bf8ea40f019ddebb26.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_ed39064f7acbd699dc5834a5a0dfae91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_d1e9dd4377b43c0a06e2a9285bf2573a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_46d5adc7dcd28fd78309d700076ba7ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_e2a29de256eadb7e370880af445eb831.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e2a29de256eadb7e370880af445eb831.jpg not downloaded yet
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_b2de5270b56d3132c601e8bb155ec718.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b2de5270b56d3132c601e8bb155ec718.jpg not downloaded yet
2025-12-05 17:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e75fe10>
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_706443d51a9da53fd0526f288ea2b0b9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_706443d51a9da53fd0526f288ea2b0b9.jpg saved to cache
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9e5c50>
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_6fb84eee4de8c5e7065c93a697afc664.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6fb84eee4de8c5e7065c93a697afc664.jpg saved to cache
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da2add0>
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_db496d6b400b5c50acc8ec256d19e0c3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_db496d6b400b5c50acc8ec256d19e0c3.jpg saved to cache
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e75c3d0>
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_6c904a093ce452654574e48f95f9392e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_6c904a093ce452654574e48f95f9392e.jpg saved to cache
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_d66c9022215ee71221a2878b86c7e6e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d66c9022215ee71221a2878b86c7e6e4.jpg not downloaded yet
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66905ee610>
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_818263c60802297360e0bb9f6060d8fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_818263c60802297360e0bb9f6060d8fc.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_70be4306a9c44598927cb570a2ba4789.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_bdc801a7beca8c0f2fcd0aef6bebe618.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_998f66d7d0336b37056d106940648c21.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_998f66d7d0336b37056d106940648c21.jpg not downloaded yet
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_61c3511abd6f58b8b8c5443a720ebf2d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_61c3511abd6f58b8b8c5443a720ebf2d.jpg not downloaded yet
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_df374f87d757f5ec6ad7170dbfacd366.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_33ebb942dd3f58217f53d7316aafb3a8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_783596f8d7165895490ae093d03a1571.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [scrapy.extensions.logstats] INFO: Crawled 767 pages (at 50 pages/min), scraped 224 items (at 21 items/min)
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_ba03ed625cf06d5084cfc813861358b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_ba03ed625cf06d5084cfc813861358b5.jpg not downloaded yet
2025-12-05 17:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4c6690>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_624c3a4e5e8c2cdd76e39461b28e3a9a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_624c3a4e5e8c2cdd76e39461b28e3a9a.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b6a10>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_225355a63cd7ccbc9feb3a0ddf0f4ac2.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_225355a63cd7ccbc9feb3a0ddf0f4ac2.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da56910>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_b4bdcd9c14d637bf8ea40f019ddebb26.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b4bdcd9c14d637bf8ea40f019ddebb26.jpg saved to cache
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db89b10>
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_ed39064f7acbd699dc5834a5a0dfae91.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_ed39064f7acbd699dc5834a5a0dfae91.jpg saved to cache
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da868d0>
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_d1e9dd4377b43c0a06e2a9285bf2573a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_d1e9dd4377b43c0a06e2a9285bf2573a.jpg saved to cache
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b6f10>
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_46d5adc7dcd28fd78309d700076ba7ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_46d5adc7dcd28fd78309d700076ba7ec.jpg saved to cache
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_9a04e69cc01ccaba079c5234806c42e3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_0f82b57770dd586e3aedcde256faa958.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b6108dfca1d2eae6e48a46af23a866dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_e11f5c24a4d776d4e05655bd4e737f0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e11f5c24a4d776d4e05655bd4e737f0a.jpg not downloaded yet
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_a0bbf9795b760f28e9f73e072e1cc85f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_a0bbf9795b760f28e9f73e072e1cc85f.jpg not downloaded yet
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_77354e3ca56372ac64b69da93fa1bff0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_77354e3ca56372ac64b69da93fa1bff0.jpg not downloaded yet
2025-12-05 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_b5567c162bf8a4dc2dd820090995536e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_0a38ca49d094c5a555ca6ef439969230.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_0a38ca49d094c5a555ca6ef439969230.jpg not downloaded yet
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_678736d453cdd6da3335452d8b53a415.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_678736d453cdd6da3335452d8b53a415.jpg not downloaded yet
2025-12-05 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH08907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a7c10>
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_70be4306a9c44598927cb570a2ba4789.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_70be4306a9c44598927cb570a2ba4789.jpg saved to cache
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cc890>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_bdc801a7beca8c0f2fcd0aef6bebe618.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_bdc801a7beca8c0f2fcd0aef6bebe618.jpg saved to cache
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a16d0>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_df374f87d757f5ec6ad7170dbfacd366.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_df374f87d757f5ec6ad7170dbfacd366.jpg saved to cache
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48e910>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_33ebb942dd3f58217f53d7316aafb3a8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_33ebb942dd3f58217f53d7316aafb3a8.jpg saved to cache
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbff250>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_783596f8d7165895490ae093d03a1571.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_783596f8d7165895490ae093d03a1571.jpg saved to cache
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_c7c649b9a193d3a1bfeff75e21ff84ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_c7c649b9a193d3a1bfeff75e21ff84ca.jpg not downloaded yet
2025-12-05 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_61c3511abd6f58b8b8c5443a720ebf2d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_998f66d7d0336b37056d106940648c21.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b2de5270b56d3132c601e8bb155ec718.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d66c9022215ee71221a2878b86c7e6e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_14f1aac077de800a738ca88897e4b1e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_14f1aac077de800a738ca88897e4b1e8.jpg not downloaded yet
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN52175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ09621> (referer: https://www.auto1.com/v1/car-details-view/XJ09621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbfec50>
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_9a04e69cc01ccaba079c5234806c42e3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_9a04e69cc01ccaba079c5234806c42e3.jpg saved to cache
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d98d150>
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_0f82b57770dd586e3aedcde256faa958.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_0f82b57770dd586e3aedcde256faa958.jpg saved to cache
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb9350>
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_b6108dfca1d2eae6e48a46af23a866dd.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b6108dfca1d2eae6e48a46af23a866dd.jpg saved to cache
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da42910>
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_b5567c162bf8a4dc2dd820090995536e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_b5567c162bf8a4dc2dd820090995536e.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_a0bbf9795b760f28e9f73e072e1cc85f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_77354e3ca56372ac64b69da93fa1bff0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE00244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL02134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ11773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV61138> (referer: https://www.auto1.com/v1/car-details-view/PV61138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc30fd0>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_61c3511abd6f58b8b8c5443a720ebf2d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_61c3511abd6f58b8b8c5443a720ebf2d.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e544290>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_998f66d7d0336b37056d106940648c21.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_998f66d7d0336b37056d106940648c21.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da2a890>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_b2de5270b56d3132c601e8bb155ec718.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b2de5270b56d3132c601e8bb155ec718.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48c910>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_d66c9022215ee71221a2878b86c7e6e4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d66c9022215ee71221a2878b86c7e6e4.jpg saved to cache
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51fea56f-7ea9-528f-8e5a-96c620f84512 with identifier: XJ09621
2025-12-05 17:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51fea56f-7ea9-528f-8e5a-96c620f84512 with scrape type 1
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_a423742004d71256b1679e58cf9e35bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a423742004d71256b1679e58cf9e35bd.jpg not downloaded yet
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e11f5c24a4d776d4e05655bd4e737f0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_0a38ca49d094c5a555ca6ef439969230.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_678736d453cdd6da3335452d8b53a415.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_ba03ed625cf06d5084cfc813861358b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e2a29de256eadb7e370880af445eb831.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_c7c649b9a193d3a1bfeff75e21ff84ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_10420cf2933c1a4cd10d02b988166cd5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_10420cf2933c1a4cd10d02b988166cd5.jpg not downloaded yet
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_14f1aac077de800a738ca88897e4b1e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR98659> (referer: https://www.auto1.com/v1/car-details-view/NR98659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4f7f50>
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_a0bbf9795b760f28e9f73e072e1cc85f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_a0bbf9795b760f28e9f73e072e1cc85f.jpg saved to cache
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e43d1d0>
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_77354e3ca56372ac64b69da93fa1bff0.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_77354e3ca56372ac64b69da93fa1bff0.jpg saved to cache
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b80ce315-9091-5b08-ae70-a573736c8b2b with identifier: PV61138
2025-12-05 17:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80ce315-9091-5b08-ae70-a573736c8b2b with scrape type 2
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b80ce315-9091-5b08-ae70-a573736c8b2b with scrape type 2
2025-12-05 17:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b80ce315-9091-5b08-ae70-a573736c8b2b, identifier: PV61138
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_a6924178672e20a80b8beee279fd376d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a6924178672e20a80b8beee279fd376d.jpg not downloaded yet
2025-12-05 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b80ce315-9091-5b08-ae70-a573736c8b2b with identifier: PV61138
2025-12-05 17:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b80ce315-9091-5b08-ae70-a573736c8b2b with identifier: PV61138
2025-12-05 17:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b80ce315-9091-5b08-ae70-a573736c8b2b spider: auto1.es
2025-12-05 17:09:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b80ce315-9091-5b08-ae70-a573736c8b2b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:10:04Z',
 'fuel_type': 'diesel',
 'id': 'b80ce315-9091-5b08-ae70-a573736c8b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV61138',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 110467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2020}
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV61138%27 HTTP/1.1" 200 None
2025-12-05 17:09:14 [auto1.es] INFO: Saving data for PV61138: {'auction_closing_time': 1765037404.0, 'created_time': 1764262965.518483, 'last_price_update_time': 1764954554.112943}
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PV61138') HTTP/1.1" 204 0
2025-12-05 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d5839b88aeb4a514388607776a8d3f20.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_fff7a6779fa6c7e7c0b098ee787e1096.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_57f6735fd8c69dfdd1458e51b2739dc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_57f6735fd8c69dfdd1458e51b2739dc9.jpg not downloaded yet
2025-12-05 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY30936> (referer: https://www.auto1.com/v1/car-details-view/PY30936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d919950>
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_e11f5c24a4d776d4e05655bd4e737f0a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e11f5c24a4d776d4e05655bd4e737f0a.jpg saved to cache
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8ad310>
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_0a38ca49d094c5a555ca6ef439969230.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_0a38ca49d094c5a555ca6ef439969230.jpg saved to cache
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e764a10>
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F81%252F7b81b97276902ff5ad3b37e81c39f596%252Fpa%252FAH84228_678736d453cdd6da3335452d8b53a415.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_678736d453cdd6da3335452d8b53a415.jpg saved to cache
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd
2025-12-05 17:09:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd, skipping ID generation
2025-12-05 17:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd with scrape type 1
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd from tracking dictionaries
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd sending to next pipeline
2025-12-05 17:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd, identifier: AH84228
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5570d0>
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_ba03ed625cf06d5084cfc813861358b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_ba03ed625cf06d5084cfc813861358b5.jpg saved to cache
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da8ef10>
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F31%252F9e31565241ab63ac6458784355e02ad3%252Fpa%252FSU76295_e2a29de256eadb7e370880af445eb831.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e2a29de256eadb7e370880af445eb831.jpg saved to cache
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb2141f0-e446-56ba-ab60-abd2b1010560
2025-12-05 17:09:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb2141f0-e446-56ba-ab60-abd2b1010560, skipping ID generation
2025-12-05 17:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2141f0-e446-56ba-ab60-abd2b1010560 with scrape type 1
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cb2141f0-e446-56ba-ab60-abd2b1010560 from tracking dictionaries
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2141f0-e446-56ba-ab60-abd2b1010560 sending to next pipeline
2025-12-05 17:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb2141f0-e446-56ba-ab60-abd2b1010560, identifier: SU76295
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8acad0>
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_c7c649b9a193d3a1bfeff75e21ff84ca.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_c7c649b9a193d3a1bfeff75e21ff84ca.jpg saved to cache
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e674c10>
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_14f1aac077de800a738ca88897e4b1e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_14f1aac077de800a738ca88897e4b1e8.jpg saved to cache
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43c4493f-ee22-5f29-a228-726d2b149590 with identifier: NR98659
2025-12-05 17:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43c4493f-ee22-5f29-a228-726d2b149590 with scrape type 1
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_2af2b66dd701310eef649c0dad3f9099.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_2af2b66dd701310eef649c0dad3f9099.jpg not downloaded yet
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a423742004d71256b1679e58cf9e35bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd with identifier: AH84228
2025-12-05 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd with identifier: AH84228
2025-12-05 17:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd with identifier: AH84228 to the API
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_678736d453cdd6da3335452d8b53a415.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:12:13Z',
 'fuel_type': 'diesel',
 'id': '20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH84228',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 124522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43804,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_53492a4ae1ce718fd690d706a38a7246.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43804,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_127be59a0dee9777e63a92f8b01ea3de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33640,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_4728d4d45540fd169275913f568e2a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33640,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_3e72c00e3c1d9e234bdc51179297f7ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33097,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_6c904a093ce452654574e48f95f9392e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37415,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_225355a63cd7ccbc9feb3a0ddf0f4ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37415,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b4bdcd9c14d637bf8ea40f019ddebb26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37415,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_70be4306a9c44598927cb570a2ba4789.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51270,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_9a04e69cc01ccaba079c5234806c42e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63469,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_b2de5270b56d3132c601e8bb155ec718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63469,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_61c3511abd6f58b8b8c5443a720ebf2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23278,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_a0bbf9795b760f28e9f73e072e1cc85f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd/20254dfe-a3e0-5ad0-ba16-9f8e6f097bdd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59184,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/81/7b81b97276902ff5ad3b37e81c39f596/pa/AH84228_678736d453cdd6da3335452d8b53a415.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2021}
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH84228%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [auto1.es] INFO: Saving data for AH84228: {'created_time': 1764954556.679186, 'last_price_update_time': 1764954556.679195, 'auction_closing_time': 1765037533.0}
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH84228') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb2141f0-e446-56ba-ab60-abd2b1010560 with identifier: SU76295
2025-12-05 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb2141f0-e446-56ba-ab60-abd2b1010560 with identifier: SU76295
2025-12-05 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cb2141f0-e446-56ba-ab60-abd2b1010560 spider: auto1.es
2025-12-05 17:09:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cb2141f0-e446-56ba-ab60-abd2b1010560 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:53:53Z',
 'fuel_type': 'diesel',
 'id': 'cb2141f0-e446-56ba-ab60-abd2b1010560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU76295',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 117897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33998,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_3e833ff2e311b905d4fb456f2acc3926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33998,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_7bbda5bda765cfc27080e71b42b9e51b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29755,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_012fec543ed91c546d44125986bceb30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29755,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e3d3ee4aa7f62cb1359d67ca3dc560bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32903,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_706443d51a9da53fd0526f288ea2b0b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33998,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_624c3a4e5e8c2cdd76e39461b28e3a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32373,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_ed39064f7acbd699dc5834a5a0dfae91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32373,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_33ebb942dd3f58217f53d7316aafb3a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60333,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_b5567c162bf8a4dc2dd820090995536e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41860,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e2a29de256eadb7e370880af445eb831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41677,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_998f66d7d0336b37056d106940648c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36491,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_e11f5c24a4d776d4e05655bd4e737f0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2141f0-e446-56ba-ab60-abd2b1010560/cb2141f0-e446-56ba-ab60-abd2b1010560_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41860,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/31/9e31565241ab63ac6458784355e02ad3/pa/SU76295_0a38ca49d094c5a555ca6ef439969230.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU76295%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [auto1.es] INFO: Saving data for SU76295: {'created_time': 1764954556.903907, 'last_price_update_time': 1764954556.903919, 'auction_closing_time': 1765040033.0}
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU76295') HTTP/1.1" 204 0
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_10420cf2933c1a4cd10d02b988166cd5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_003eda7972fc85e62627efeabbc9e2cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_003eda7972fc85e62627efeabbc9e2cd.jpg not downloaded yet
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_eaef3340093dd9c57f03245656f9c3cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_eaef3340093dd9c57f03245656f9c3cc.jpg not downloaded yet
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU53560> (referer: https://www.auto1.com/v1/car-details-view/GU53560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR65471> (referer: https://www.auto1.com/v1/car-details-view/PR65471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH08907> (referer: https://www.auto1.com/v1/car-details-view/PH08907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT96929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ79788> (referer: https://www.auto1.com/v1/car-details-view/KZ79788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_82f28dcf498bd17b2e735885765c5961.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_82f28dcf498bd17b2e735885765c5961.jpg not downloaded yet
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_10685ea280a23140b0639486a34895c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_10685ea280a23140b0639486a34895c9.jpg not downloaded yet
2025-12-05 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8bd490>
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fec%252F03ec8a19c1a33479e3e7200cd2e872b5%252Fpa%252FAA62489_d5839b88aeb4a514388607776a8d3f20.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d5839b88aeb4a514388607776a8d3f20.jpg saved to cache
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e20bab63-05a4-5d55-90d5-259d45169b0e
2025-12-05 17:09:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e20bab63-05a4-5d55-90d5-259d45169b0e, skipping ID generation
2025-12-05 17:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e20bab63-05a4-5d55-90d5-259d45169b0e with scrape type 1
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e20bab63-05a4-5d55-90d5-259d45169b0e from tracking dictionaries
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e20bab63-05a4-5d55-90d5-259d45169b0e sending to next pipeline
2025-12-05 17:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e20bab63-05a4-5d55-90d5-259d45169b0e, identifier: AA62489
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc24910>
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fbf%252F61bf857e4c011f110f2fa6ab752b3886%252Fpa%252FGD96129_fff7a6779fa6c7e7c0b098ee787e1096.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_fff7a6779fa6c7e7c0b098ee787e1096.jpg saved to cache
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cc8dd59-d455-52e6-a855-aad75d840de8
2025-12-05 17:09:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3cc8dd59-d455-52e6-a855-aad75d840de8, skipping ID generation
2025-12-05 17:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc8dd59-d455-52e6-a855-aad75d840de8 with scrape type 1
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3cc8dd59-d455-52e6-a855-aad75d840de8 from tracking dictionaries
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cc8dd59-d455-52e6-a855-aad75d840de8 sending to next pipeline
2025-12-05 17:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cc8dd59-d455-52e6-a855-aad75d840de8, identifier: GD96129
2025-12-05 17:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdce994c-28ce-589f-97f7-364c0468c550 with identifier: PY30936
2025-12-05 17:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdce994c-28ce-589f-97f7-364c0468c550 with scrape type 2
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdce994c-28ce-589f-97f7-364c0468c550 with scrape type 2
2025-12-05 17:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdce994c-28ce-589f-97f7-364c0468c550, identifier: PY30936
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e92a550>
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_a423742004d71256b1679e58cf9e35bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a423742004d71256b1679e58cf9e35bd.jpg saved to cache
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_57f6735fd8c69dfdd1458e51b2739dc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_d1f12769633ec0fa3d55139024fc9c7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_d1f12769633ec0fa3d55139024fc9c7f.jpg not downloaded yet
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_de632de5e69d2618af9d0803d4d90e7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_de632de5e69d2618af9d0803d4d90e7e.jpg not downloaded yet
2025-12-05 17:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e20bab63-05a4-5d55-90d5-259d45169b0e with identifier: AA62489
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e20bab63-05a4-5d55-90d5-259d45169b0e with identifier: AA62489
2025-12-05 17:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e20bab63-05a4-5d55-90d5-259d45169b0e with identifier: AA62489 to the API
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d5839b88aeb4a514388607776a8d3f20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:42:54Z',
 'fuel_type': 'diesel',
 'id': 'e20bab63-05a4-5d55-90d5-259d45169b0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA62489',
 'listing': 'auction',
 'location': 'San Juan de Aznalfarache, Sevilla',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 124452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a623ffc06f9481914ef6b850cd94f10f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_25eaa9cfec51820d1015c4059bcbf008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_2046a985e4ca7978306e4bd96cfcbb4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_70038ae73fa9402a32cbd77f5f4c0ee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_a344caba0a5a576f2da7bd544c71aee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_db496d6b400b5c50acc8ec256d19e0c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_818263c60802297360e0bb9f6060d8fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_46d5adc7dcd28fd78309d700076ba7ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_bdc801a7beca8c0f2fcd0aef6bebe618.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_0f82b57770dd586e3aedcde256faa958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d5839b88aeb4a514388607776a8d3f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_d66c9022215ee71221a2878b86c7e6e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_ba03ed625cf06d5084cfc813861358b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_77354e3ca56372ac64b69da93fa1bff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_c7c649b9a193d3a1bfeff75e21ff84ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20bab63-05a4-5d55-90d5-259d45169b0e/e20bab63-05a4-5d55-90d5-259d45169b0e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/ec/03ec8a19c1a33479e3e7200cd2e872b5/pa/AA62489_14f1aac077de800a738ca88897e4b1e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA62489%27 HTTP/1.1" 200 None
2025-12-05 17:09:18 [auto1.es] INFO: Saving data for AA62489: {'created_time': 1764954558.476545, 'last_price_update_time': 1764954558.476555, 'auction_closing_time': 1765039374.0}
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AA62489') HTTP/1.1" 204 0
2025-12-05 17:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cc8dd59-d455-52e6-a855-aad75d840de8 with identifier: GD96129
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cc8dd59-d455-52e6-a855-aad75d840de8 with identifier: GD96129
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv200 evalia' containing 'nv'
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3cc8dd59-d455-52e6-a855-aad75d840de8 spider: auto1.es
2025-12-05 17:09:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3cc8dd59-d455-52e6-a855-aad75d840de8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv200 evalia' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:48:04Z',
 'fuel_type': 'diesel',
 'id': '3cc8dd59-d455-52e6-a855-aad75d840de8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD96129',
 'listing': 'auction',
 'location': 'ES, Cáceres',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 136955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_fff7a6779fa6c7e7c0b098ee787e1096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b6108dfca1d2eae6e48a46af23a866dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_783596f8d7165895490ae093d03a1571.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_df374f87d757f5ec6ad7170dbfacd366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_d1e9dd4377b43c0a06e2a9285bf2573a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_39cb803b2fd1083dab7ed8cfd1b228c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4d0b0c7a84d80ced46a0b0f6833558ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6fb84eee4de8c5e7065c93a697afc664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b2f6d9cef6300268eb38522ab21ca538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_e0d9f550d1518b9ba7518d2f823c6d1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_6087f73e91f5c9ad2ec876739e630924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_4c64af48c12ceca5972cf20de0764b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_0ea58f32d91249fb036b5f942447173a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_8149fa7945059e7922bcbb51c6c20433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_16cf61652a08f69b779ff4c8d84007b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cc8dd59-d455-52e6-a855-aad75d840de8/3cc8dd59-d455-52e6-a855-aad75d840de8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/bf/61bf857e4c011f110f2fa6ab752b3886/pa/GD96129_b044f57db3ec677af872f517278f4c2e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Kasten Comfort',
 'transmission': 'manual',
 'trim': 'Kasten Comfort',
 'year': 2019}
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD96129%27 HTTP/1.1" 200 None
2025-12-05 17:09:18 [auto1.es] INFO: Saving data for GD96129: {'created_time': 1764954558.710914, 'last_price_update_time': 1764954558.710927, 'auction_closing_time': 1765039684.0}
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GD96129') HTTP/1.1" 204 0
2025-12-05 17:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdce994c-28ce-589f-97f7-364c0468c550 with identifier: PY30936
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdce994c-28ce-589f-97f7-364c0468c550 with identifier: PY30936
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bdce994c-28ce-589f-97f7-364c0468c550 spider: auto1.es
2025-12-05 17:09:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bdce994c-28ce-589f-97f7-364c0468c550 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:27:00Z',
 'fuel_type': 'diesel',
 'id': 'bdce994c-28ce-589f-97f7-364c0468c550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY30936',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 91264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2021}
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY30936%27 HTTP/1.1" 200 None
2025-12-05 17:09:18 [auto1.es] INFO: Saving data for PY30936: {'auction_closing_time': 1765038420.0, 'created_time': 1764003769.134184, 'last_price_update_time': 1764954558.923135}
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY30936') HTTP/1.1" 204 0
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a6924178672e20a80b8beee279fd376d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_2af2b66dd701310eef649c0dad3f9099.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da70350>
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_10420cf2933c1a4cd10d02b988166cd5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_10420cf2933c1a4cd10d02b988166cd5.jpg saved to cache
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_49a7c2a77ddd7728a6c01a1eb32219ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_49a7c2a77ddd7728a6c01a1eb32219ea.jpg not downloaded yet
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_67655bb2567411b84f9997ac51a8496e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_67655bb2567411b84f9997ac51a8496e.jpg not downloaded yet
2025-12-05 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN52175> (referer: https://www.auto1.com/v1/car-details-view/CN52175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_003eda7972fc85e62627efeabbc9e2cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 268802f7-2483-5b5f-aba7-3917308fd82a with identifier: GU53560
2025-12-05 17:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268802f7-2483-5b5f-aba7-3917308fd82a with scrape type 2
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 268802f7-2483-5b5f-aba7-3917308fd82a with scrape type 2
2025-12-05 17:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 268802f7-2483-5b5f-aba7-3917308fd82a, identifier: GU53560
2025-12-05 17:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eb07baf-d019-599a-8f7c-37db5a7695f3 with identifier: PR65471
2025-12-05 17:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eb07baf-d019-599a-8f7c-37db5a7695f3 with scrape type 1
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_36364a1f4b0d08fd45b3d51e7c97615d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_36364a1f4b0d08fd45b3d51e7c97615d.jpg not downloaded yet
2025-12-05 17:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58415d3b-4093-5ac1-b7e5-e470e0c77f45 with identifier: PH08907
2025-12-05 17:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45 with scrape type 1
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_47bbaab28e8c0cbd18750ca92c2ff824.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_47bbaab28e8c0cbd18750ca92c2ff824.jpg not downloaded yet
2025-12-05 17:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8152d716-c2f0-53ff-a73e-afea2334ea2e with identifier: KZ79788
2025-12-05 17:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8152d716-c2f0-53ff-a73e-afea2334ea2e with scrape type 2
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8152d716-c2f0-53ff-a73e-afea2334ea2e with scrape type 2
2025-12-05 17:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8152d716-c2f0-53ff-a73e-afea2334ea2e, identifier: KZ79788
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d930590>
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_57f6735fd8c69dfdd1458e51b2739dc9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_57f6735fd8c69dfdd1458e51b2739dc9.jpg saved to cache
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_82f28dcf498bd17b2e735885765c5961.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_eaef3340093dd9c57f03245656f9c3cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_2a17b7ee88d6dc182492299bf434811c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_2a17b7ee88d6dc182492299bf434811c.jpg not downloaded yet
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_6efc88a44a8466233a5d1695fb50088a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_6efc88a44a8466233a5d1695fb50088a.jpg not downloaded yet
2025-12-05 17:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 268802f7-2483-5b5f-aba7-3917308fd82a with identifier: GU53560
2025-12-05 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 268802f7-2483-5b5f-aba7-3917308fd82a with identifier: GU53560
2025-12-05 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 268802f7-2483-5b5f-aba7-3917308fd82a spider: auto1.es
2025-12-05 17:09:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 268802f7-2483-5b5f-aba7-3917308fd82a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:59:42Z',
 'fuel_type': 'diesel',
 'id': '268802f7-2483-5b5f-aba7-3917308fd82a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU53560',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 92762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU53560%27 HTTP/1.1" 200 None
2025-12-05 17:09:19 [auto1.es] INFO: Saving data for GU53560: {'auction_closing_time': 1765040382.0, 'created_time': 1762967062.223152, 'last_price_update_time': 1764954559.964597}
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU53560') HTTP/1.1" 204 0
2025-12-05 17:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8152d716-c2f0-53ff-a73e-afea2334ea2e with identifier: KZ79788
2025-12-05 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8152d716-c2f0-53ff-a73e-afea2334ea2e with identifier: KZ79788
2025-12-05 17:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161398 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161398
2025-12-05 17:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8152d716-c2f0-53ff-a73e-afea2334ea2e spider: auto1.es
2025-12-05 17:09:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8152d716-c2f0-53ff-a73e-afea2334ea2e due to rule: high_mileage_for_country.json, error: 161398 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161398
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:19:33Z',
 'fuel_type': 'diesel',
 'id': '8152d716-c2f0-53ff-a73e-afea2334ea2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ79788',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 161398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ79788%27 HTTP/1.1" 200 None
2025-12-05 17:09:20 [auto1.es] INFO: Saving data for KZ79788: {'auction_closing_time': 1765037973.0, 'created_time': 1761584731.48269, 'last_price_update_time': 1764954560.1991}
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ79788') HTTP/1.1" 204 0
2025-12-05 17:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_10685ea280a23140b0639486a34895c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_d01f04c2b110f2c956b04e1affdd7f58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_d01f04c2b110f2c956b04e1affdd7f58.jpg not downloaded yet
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_f0d5d26511fccc24dc90cbdd35f0cec0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_f0d5d26511fccc24dc90cbdd35f0cec0.jpg not downloaded yet
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d67d0>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_a6924178672e20a80b8beee279fd376d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a6924178672e20a80b8beee279fd376d.jpg saved to cache
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d5910>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_2af2b66dd701310eef649c0dad3f9099.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_2af2b66dd701310eef649c0dad3f9099.jpg saved to cache
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_b2a060a0e5e79785609e8695421e099a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_b2a060a0e5e79785609e8695421e099a.jpg not downloaded yet
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_a234dc43c9bbb31b03c3b017ef58a2a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a234dc43c9bbb31b03c3b017ef58a2a1.jpg not downloaded yet
2025-12-05 17:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200935d7-7014-584b-84eb-7e21a96d9271 with identifier: CN52175
2025-12-05 17:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200935d7-7014-584b-84eb-7e21a96d9271 with scrape type 2
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200935d7-7014-584b-84eb-7e21a96d9271 with scrape type 2
2025-12-05 17:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 200935d7-7014-584b-84eb-7e21a96d9271, identifier: CN52175
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b5a50>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_003eda7972fc85e62627efeabbc9e2cd.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_003eda7972fc85e62627efeabbc9e2cd.jpg saved to cache
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_d1f12769633ec0fa3d55139024fc9c7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_0d8704c9f77c99d1677618965ac758b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_0d8704c9f77c99d1677618965ac758b6.jpg not downloaded yet
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_d40c418dcdf4cd3011947313cea1f219.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d40c418dcdf4cd3011947313cea1f219.jpg not downloaded yet
2025-12-05 17:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC38257> (referer: https://www.auto1.com/v1/car-details-view/YC38257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 200935d7-7014-584b-84eb-7e21a96d9271 with identifier: CN52175
2025-12-05 17:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 200935d7-7014-584b-84eb-7e21a96d9271 with identifier: CN52175
2025-12-05 17:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 508 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '508', 'transmission': 'automatic', 'odometer': 82938, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cn52175', 'expiration_date': '2025-12-06t16:01:55z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '200935d7-7014-584b-84eb-7e21a96d9271', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'peugeot 508', 'sanitized_make': 'peugeot', 'odometer_in_km': 82938}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:01:55z',
     'fuel_type': 'petrol',
     'id': '200935d7-7014-584b-84eb-7e21a96d9271',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cn52175',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 508',
     'model': '508',
     'odometer': 82938,
     'odometer_in_km': 82938,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 508 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2023}
2025-12-05 17:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 200935d7-7014-584b-84eb-7e21a96d9271 spider: auto1.es
2025-12-05 17:09:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 200935d7-7014-584b-84eb-7e21a96d9271 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 508 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '508', 'transmission': 'automatic', 'odometer': 82938, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cn52175', 'expiration_date': '2025-12-06t16:01:55z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '200935d7-7014-584b-84eb-7e21a96d9271', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'peugeot 508', 'sanitized_make': 'peugeot', 'odometer_in_km': 82938}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2025-12-06t16:01:55z',
     'fuel_type': 'petrol',
     'id': '200935d7-7014-584b-84eb-7e21a96d9271',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cn52175',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 508',
     'model': '508',
     'odometer': 82938,
     'odometer_in_km': 82938,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 508 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:01:55Z',
 'fuel_type': 'petrol',
 'id': '200935d7-7014-584b-84eb-7e21a96d9271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN52175',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 82938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN52175%27 HTTP/1.1" 200 None
2025-12-05 17:09:21 [auto1.es] INFO: Saving data for CN52175: {'auction_closing_time': 1765036915.0, 'created_time': 1764003772.301218, 'last_price_update_time': 1764954561.421473}
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN52175') HTTP/1.1" 204 0
2025-12-05 17:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_49a7c2a77ddd7728a6c01a1eb32219ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_de632de5e69d2618af9d0803d4d90e7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_ca5e6538a1e8939c221cc2aa955c7d8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_ca5e6538a1e8939c221cc2aa955c7d8d.jpg not downloaded yet
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_fea85dc615ab4994585cfe9a400a0d82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_fea85dc615ab4994585cfe9a400a0d82.jpg not downloaded yet
2025-12-05 17:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a7450>
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_82f28dcf498bd17b2e735885765c5961.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_82f28dcf498bd17b2e735885765c5961.jpg saved to cache
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8ea510>
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_eaef3340093dd9c57f03245656f9c3cc.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_eaef3340093dd9c57f03245656f9c3cc.jpg saved to cache
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4999d0>
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_10685ea280a23140b0639486a34895c9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_10685ea280a23140b0639486a34895c9.jpg saved to cache
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_67655bb2567411b84f9997ac51a8496e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_2864486c18238e3ff8984d7cec31204d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_2864486c18238e3ff8984d7cec31204d.jpg not downloaded yet
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_9b72f90a8511faca955c371af3940816.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_9b72f90a8511faca955c371af3940816.jpg not downloaded yet
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_47bbaab28e8c0cbd18750ca92c2ff824.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_36364a1f4b0d08fd45b3d51e7c97615d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_4725b97e9350880fc30b7ecdb7a86eb9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_4725b97e9350880fc30b7ecdb7a86eb9.jpg not downloaded yet
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_856478b2970c26ff684f11f5aa6e1cd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_856478b2970c26ff684f11f5aa6e1cd2.jpg not downloaded yet
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG59071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d925150>
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_d1f12769633ec0fa3d55139024fc9c7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_d1f12769633ec0fa3d55139024fc9c7f.jpg saved to cache
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2277ce91-56ec-5fa1-a8de-b6b54b7b950b with identifier: YC38257
2025-12-05 17:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2277ce91-56ec-5fa1-a8de-b6b54b7b950b with scrape type 2
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2277ce91-56ec-5fa1-a8de-b6b54b7b950b with scrape type 2
2025-12-05 17:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2277ce91-56ec-5fa1-a8de-b6b54b7b950b, identifier: YC38257
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_6ab3b2b052a30b6ad129b8a3f42bedc2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_6ab3b2b052a30b6ad129b8a3f42bedc2.jpg not downloaded yet
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_6bd88e4d7bbe0453e3511a19835ab1e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6bd88e4d7bbe0453e3511a19835ab1e5.jpg not downloaded yet
2025-12-05 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ11773> (referer: https://www.auto1.com/v1/car-details-view/VZ11773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2277ce91-56ec-5fa1-a8de-b6b54b7b950b with identifier: YC38257
2025-12-05 17:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2277ce91-56ec-5fa1-a8de-b6b54b7b950b with identifier: YC38257
2025-12-05 17:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2277ce91-56ec-5fa1-a8de-b6b54b7b950b with identifier: YC38257 to the API
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC38257>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:02:01Z',
 'fuel_type': 'diesel',
 'id': '2277ce91-56ec-5fa1-a8de-b6b54b7b950b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC38257',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 132210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC38257%27 HTTP/1.1" 200 None
2025-12-05 17:09:23 [auto1.es] INFO: Saving data for YC38257: {'auction_closing_time': 1765036921.0, 'created_time': 1762859800.4496, 'last_price_update_time': 1764954563.072043}
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC38257') HTTP/1.1" 204 0
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d90a850>
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_49a7c2a77ddd7728a6c01a1eb32219ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_49a7c2a77ddd7728a6c01a1eb32219ea.jpg saved to cache
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e45a0d0>
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_de632de5e69d2618af9d0803d4d90e7e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_de632de5e69d2618af9d0803d4d90e7e.jpg saved to cache
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_7e37a23492c66073a1342255ce81d1e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_7e37a23492c66073a1342255ce81d1e8.jpg not downloaded yet
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_d01f04c2b110f2c956b04e1affdd7f58.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_f0d5d26511fccc24dc90cbdd35f0cec0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_b2a060a0e5e79785609e8695421e099a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a234dc43c9bbb31b03c3b017ef58a2a1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_ce82e8c182836fc41a5873f1d605d250.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_ce82e8c182836fc41a5873f1d605d250.jpg not downloaded yet
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_a791aee0c69cb39e79c0eba3bdc7f2f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_a791aee0c69cb39e79c0eba3bdc7f2f3.jpg not downloaded yet
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB37326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8cc790>
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_67655bb2567411b84f9997ac51a8496e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_67655bb2567411b84f9997ac51a8496e.jpg saved to cache
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f3510>
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_47bbaab28e8c0cbd18750ca92c2ff824.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_47bbaab28e8c0cbd18750ca92c2ff824.jpg saved to cache
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d95b4d0>
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_36364a1f4b0d08fd45b3d51e7c97615d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_36364a1f4b0d08fd45b3d51e7c97615d.jpg saved to cache
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d40c418dcdf4cd3011947313cea1f219.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_ca5e6538a1e8939c221cc2aa955c7d8d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_a3473175c63614565828b31dba037974.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a3473175c63614565828b31dba037974.jpg not downloaded yet
2025-12-05 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL02134> (referer: https://www.auto1.com/v1/car-details-view/DL02134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 127f55a4-c955-53d9-b36e-53d73ec1f79a with identifier: VZ11773
2025-12-05 17:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 127f55a4-c955-53d9-b36e-53d73ec1f79a with scrape type 2
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 127f55a4-c955-53d9-b36e-53d73ec1f79a with scrape type 2
2025-12-05 17:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 127f55a4-c955-53d9-b36e-53d73ec1f79a, identifier: VZ11773
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_14a1c0e295b16ba4110a1d8ad39ce01d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_14a1c0e295b16ba4110a1d8ad39ce01d.jpg not downloaded yet
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_4f58729f02fa2ed5caaf6c14e2f9517e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_4f58729f02fa2ed5caaf6c14e2f9517e.jpg not downloaded yet
2025-12-05 17:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 127f55a4-c955-53d9-b36e-53d73ec1f79a with identifier: VZ11773
2025-12-05 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 127f55a4-c955-53d9-b36e-53d73ec1f79a with identifier: VZ11773
2025-12-05 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 127f55a4-c955-53d9-b36e-53d73ec1f79a spider: auto1.es
2025-12-05 17:09:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 127f55a4-c955-53d9-b36e-53d73ec1f79a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:02:41Z',
 'fuel_type': 'diesel',
 'id': '127f55a4-c955-53d9-b36e-53d73ec1f79a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ11773',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 93848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ11773%27 HTTP/1.1" 200 None
2025-12-05 17:09:24 [auto1.es] INFO: Saving data for VZ11773: {'auction_closing_time': 1765036961.0, 'created_time': 1764003683.831477, 'last_price_update_time': 1764954564.756518}
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VZ11773') HTTP/1.1" 204 0
2025-12-05 17:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_9b72f90a8511faca955c371af3940816.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_fea85dc615ab4994585cfe9a400a0d82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_b8280288cafa812601da7d9f178b5363.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_b8280288cafa812601da7d9f178b5363.jpg not downloaded yet
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db28190>
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_d01f04c2b110f2c956b04e1affdd7f58.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_d01f04c2b110f2c956b04e1affdd7f58.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e92a1d0>
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_f0d5d26511fccc24dc90cbdd35f0cec0.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_f0d5d26511fccc24dc90cbdd35f0cec0.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b32d0>
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_b2a060a0e5e79785609e8695421e099a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_b2a060a0e5e79785609e8695421e099a.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e765710>
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_a234dc43c9bbb31b03c3b017ef58a2a1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a234dc43c9bbb31b03c3b017ef58a2a1.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_4725b97e9350880fc30b7ecdb7a86eb9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_856478b2970c26ff684f11f5aa6e1cd2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_74f83d2fb027e40c56d2eda8529dcec1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_74f83d2fb027e40c56d2eda8529dcec1.jpg not downloaded yet
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_1320a27eebf3c360e97dde558b9332f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_1320a27eebf3c360e97dde558b9332f1.jpg not downloaded yet
2025-12-05 17:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_2864486c18238e3ff8984d7cec31204d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6bd88e4d7bbe0453e3511a19835ab1e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_6ab3b2b052a30b6ad129b8a3f42bedc2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg not downloaded yet
2025-12-05 17:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE00244> (referer: https://www.auto1.com/v1/car-details-view/PE00244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4dd550>
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_d40c418dcdf4cd3011947313cea1f219.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d40c418dcdf4cd3011947313cea1f219.jpg saved to cache
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8c21d0>
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_ca5e6538a1e8939c221cc2aa955c7d8d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_ca5e6538a1e8939c221cc2aa955c7d8d.jpg saved to cache
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29645b1e-499c-5271-86d9-b6b9a0bb920a with identifier: DL02134
2025-12-05 17:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29645b1e-499c-5271-86d9-b6b9a0bb920a with scrape type 1
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_926015240d814be2dcf66202f37f3788.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_926015240d814be2dcf66202f37f3788.jpg not downloaded yet
2025-12-05 17:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_7e37a23492c66073a1342255ce81d1e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_1a1dda4f97a624e8bdbee390fc582952.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_1a1dda4f97a624e8bdbee390fc582952.jpg not downloaded yet
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_80f8d0479f4b14b1d86fef73135dfd81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_80f8d0479f4b14b1d86fef73135dfd81.jpg not downloaded yet
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_9ac511a4dd4da0d817c51afddcfbb05b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_9ac511a4dd4da0d817c51afddcfbb05b.jpg not downloaded yet
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_49acc763905b64602fe8755062527834.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_49acc763905b64602fe8755062527834.jpg not downloaded yet
2025-12-05 17:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_0d8704c9f77c99d1677618965ac758b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_6efc88a44a8466233a5d1695fb50088a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_50e6939ac325f91b3e3129061be6cc3c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_50e6939ac325f91b3e3129061be6cc3c.jpg not downloaded yet
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_6b5ad2ad9e3863047b5e195028718270.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6b5ad2ad9e3863047b5e195028718270.jpg not downloaded yet
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e47f890>
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_9b72f90a8511faca955c371af3940816.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_9b72f90a8511faca955c371af3940816.jpg saved to cache
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d931b10>
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_fea85dc615ab4994585cfe9a400a0d82.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_fea85dc615ab4994585cfe9a400a0d82.jpg saved to cache
2025-12-05 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a4790>
2025-12-05 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_4725b97e9350880fc30b7ecdb7a86eb9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_4725b97e9350880fc30b7ecdb7a86eb9.jpg saved to cache
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4a3790>
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_856478b2970c26ff684f11f5aa6e1cd2.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_856478b2970c26ff684f11f5aa6e1cd2.jpg saved to cache
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9327d0>
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_2864486c18238e3ff8984d7cec31204d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_2864486c18238e3ff8984d7cec31204d.jpg saved to cache
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbe9610>
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_6bd88e4d7bbe0453e3511a19835ab1e5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6bd88e4d7bbe0453e3511a19835ab1e5.jpg saved to cache
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8cbad0>
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_6ab3b2b052a30b6ad129b8a3f42bedc2.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_6ab3b2b052a30b6ad129b8a3f42bedc2.jpg saved to cache
2025-12-05 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26d2e69-b024-51f4-906a-957b344ac75e with identifier: PE00244
2025-12-05 17:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26d2e69-b024-51f4-906a-957b344ac75e with scrape type 2
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26d2e69-b024-51f4-906a-957b344ac75e with scrape type 2
2025-12-05 17:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a26d2e69-b024-51f4-906a-957b344ac75e, identifier: PE00244
2025-12-05 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_a791aee0c69cb39e79c0eba3bdc7f2f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a3473175c63614565828b31dba037974.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_3f7b0831188e3f866590ec16491527ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_3f7b0831188e3f866590ec16491527ef.jpg not downloaded yet
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_36fdaa6acb90a9b3c3baf3b048c79c86.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_36fdaa6acb90a9b3c3baf3b048c79c86.jpg not downloaded yet
2025-12-05 17:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a26d2e69-b024-51f4-906a-957b344ac75e with identifier: PE00244
2025-12-05 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a26d2e69-b024-51f4-906a-957b344ac75e with identifier: PE00244
2025-12-05 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a26d2e69-b024-51f4-906a-957b344ac75e spider: auto1.es
2025-12-05 17:09:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a26d2e69-b024-51f4-906a-957b344ac75e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:35:33Z',
 'fuel_type': 'diesel',
 'id': 'a26d2e69-b024-51f4-906a-957b344ac75e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE00244',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 80202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE00244%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [auto1.es] INFO: Saving data for PE00244: {'auction_closing_time': 1765038933.0, 'created_time': 1762966951.763369, 'last_price_update_time': 1764954568.502567}
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE00244') HTTP/1.1" 204 0
2025-12-05 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_b8280288cafa812601da7d9f178b5363.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_4f58729f02fa2ed5caaf6c14e2f9517e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_25d7ee2fec06a4b7d2d9832404ac29fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_25d7ee2fec06a4b7d2d9832404ac29fe.jpg not downloaded yet
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_df15a28400fa57f1dd0d2fe3e9181ee9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_df15a28400fa57f1dd0d2fe3e9181ee9.jpg not downloaded yet
2025-12-05 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_14a1c0e295b16ba4110a1d8ad39ce01d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_ce82e8c182836fc41a5873f1d605d250.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_44c9051ecee9a41edd81ef6025c04391.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_44c9051ecee9a41edd81ef6025c04391.jpg not downloaded yet
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_f5f92026fbbf4d2999943b0129b29b46.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_f5f92026fbbf4d2999943b0129b29b46.jpg not downloaded yet
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e49b150>
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_7e37a23492c66073a1342255ce81d1e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_7e37a23492c66073a1342255ce81d1e8.jpg saved to cache
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74f5d0>
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_0d8704c9f77c99d1677618965ac758b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_0d8704c9f77c99d1677618965ac758b6.jpg saved to cache
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9a6810>
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_6efc88a44a8466233a5d1695fb50088a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_6efc88a44a8466233a5d1695fb50088a.jpg saved to cache
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_1320a27eebf3c360e97dde558b9332f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_74f83d2fb027e40c56d2eda8529dcec1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_f6075722d407547358c062ce925459c2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_f6075722d407547358c062ce925459c2.jpg not downloaded yet
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_e59086548db174cab4b60dbff41dfdad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e59086548db174cab4b60dbff41dfdad.jpg not downloaded yet
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_9ac511a4dd4da0d817c51afddcfbb05b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_49acc763905b64602fe8755062527834.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_1a1dda4f97a624e8bdbee390fc582952.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_80f8d0479f4b14b1d86fef73135dfd81.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_b06ef647e1e0a1d56abebf5efbb95510.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_b06ef647e1e0a1d56abebf5efbb95510.jpg not downloaded yet
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d94a2d0>
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_a791aee0c69cb39e79c0eba3bdc7f2f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_a791aee0c69cb39e79c0eba3bdc7f2f3.jpg saved to cache
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbff750>
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_a3473175c63614565828b31dba037974.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a3473175c63614565828b31dba037974.jpg saved to cache
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_a6dbfdaf676b25cfb15b4ce86bfbec73.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_a6dbfdaf676b25cfb15b4ce86bfbec73.jpg not downloaded yet
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_d680476da87e98e665f69c58b2435620.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d680476da87e98e665f69c58b2435620.jpg not downloaded yet
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6b5ad2ad9e3863047b5e195028718270.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_50e6939ac325f91b3e3129061be6cc3c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_c2c10c76725b5c6774b9f95543f1fd47.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c2c10c76725b5c6774b9f95543f1fd47.jpg not downloaded yet
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_897edeaf81f3caeae6bf2f719a51ae91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_897edeaf81f3caeae6bf2f719a51ae91.jpg not downloaded yet
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_e4c119cd244b5329a81f5c6202d781a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e4c119cd244b5329a81f5c6202d781a5.jpg not downloaded yet
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d890c10>
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_b8280288cafa812601da7d9f178b5363.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_b8280288cafa812601da7d9f178b5363.jpg saved to cache
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5b8fd0>
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_4f58729f02fa2ed5caaf6c14e2f9517e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_4f58729f02fa2ed5caaf6c14e2f9517e.jpg saved to cache
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8903d0>
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_14a1c0e295b16ba4110a1d8ad39ce01d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_14a1c0e295b16ba4110a1d8ad39ce01d.jpg saved to cache
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da40c50>
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_ce82e8c182836fc41a5873f1d605d250.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_ce82e8c182836fc41a5873f1d605d250.jpg saved to cache
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db7c9d0>
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_1320a27eebf3c360e97dde558b9332f1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_1320a27eebf3c360e97dde558b9332f1.jpg saved to cache
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9cfbd0>
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_74f83d2fb027e40c56d2eda8529dcec1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_74f83d2fb027e40c56d2eda8529dcec1.jpg saved to cache
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d92a990>
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_9ac511a4dd4da0d817c51afddcfbb05b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_9ac511a4dd4da0d817c51afddcfbb05b.jpg saved to cache
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da099d0>
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_49acc763905b64602fe8755062527834.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_49acc763905b64602fe8755062527834.jpg saved to cache
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da6d650>
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_1a1dda4f97a624e8bdbee390fc582952.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_1a1dda4f97a624e8bdbee390fc582952.jpg saved to cache
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8f0a10>
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_80f8d0479f4b14b1d86fef73135dfd81.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_80f8d0479f4b14b1d86fef73135dfd81.jpg saved to cache
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_490aeea5b55ed137366f13f6de3aa851.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_490aeea5b55ed137366f13f6de3aa851.jpg not downloaded yet
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_25d7ee2fec06a4b7d2d9832404ac29fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_f5f92026fbbf4d2999943b0129b29b46.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_36fdaa6acb90a9b3c3baf3b048c79c86.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_cc8ff68b4a2503be4589f9c5563c97b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_cc8ff68b4a2503be4589f9c5563c97b1.jpg not downloaded yet
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_11bac042b66ebf808e9982b55f471703.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_11bac042b66ebf808e9982b55f471703.jpg not downloaded yet
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_926015240d814be2dcf66202f37f3788.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_df15a28400fa57f1dd0d2fe3e9181ee9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_3f7b0831188e3f866590ec16491527ef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_44c9051ecee9a41edd81ef6025c04391.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_e2f5b038f03c3e713b153f02e89f6964.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_e2f5b038f03c3e713b153f02e89f6964.jpg not downloaded yet
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN11011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG46057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8cb390>
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_6b5ad2ad9e3863047b5e195028718270.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6b5ad2ad9e3863047b5e195028718270.jpg saved to cache
2025-12-05 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d99a250>
2025-12-05 17:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_50e6939ac325f91b3e3129061be6cc3c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_50e6939ac325f91b3e3129061be6cc3c.jpg saved to cache
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_3a2094940cd122bb3575afa90d890723.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_3a2094940cd122bb3575afa90d890723.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_16dee9dbfaa2c5b4d01e8306deb57a27.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_16dee9dbfaa2c5b4d01e8306deb57a27.jpg not downloaded yet
2025-12-05 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_6bf1c4c687b2ec0d2a6715c79aa00b58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_6bf1c4c687b2ec0d2a6715c79aa00b58.jpg not downloaded yet
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db26650>
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_25d7ee2fec06a4b7d2d9832404ac29fe.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_25d7ee2fec06a4b7d2d9832404ac29fe.jpg saved to cache
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb1750>
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_f5f92026fbbf4d2999943b0129b29b46.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_f5f92026fbbf4d2999943b0129b29b46.jpg saved to cache
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6de650>
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_36fdaa6acb90a9b3c3baf3b048c79c86.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_36fdaa6acb90a9b3c3baf3b048c79c86.jpg saved to cache
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e4c7e10>
2025-12-05 17:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_926015240d814be2dcf66202f37f3788.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_926015240d814be2dcf66202f37f3788.jpg saved to cache
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da341d0>
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_df15a28400fa57f1dd0d2fe3e9181ee9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_df15a28400fa57f1dd0d2fe3e9181ee9.jpg saved to cache
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668da56d10>
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_3f7b0831188e3f866590ec16491527ef.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_3f7b0831188e3f866590ec16491527ef.jpg saved to cache
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7641d0>
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_44c9051ecee9a41edd81ef6025c04391.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_44c9051ecee9a41edd81ef6025c04391.jpg saved to cache
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_a6dbfdaf676b25cfb15b4ce86bfbec73.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d680476da87e98e665f69c58b2435620.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_b06ef647e1e0a1d56abebf5efbb95510.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_490aeea5b55ed137366f13f6de3aa851.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_d02343aa7096d2aae5ad5b36b308ae64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_d02343aa7096d2aae5ad5b36b308ae64.jpg not downloaded yet
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c2c10c76725b5c6774b9f95543f1fd47.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e4c119cd244b5329a81f5c6202d781a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_897edeaf81f3caeae6bf2f719a51ae91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_c380e9c5ff8603a95e994b5501e1f026.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c380e9c5ff8603a95e994b5501e1f026.jpg not downloaded yet
2025-12-05 17:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e745010>
2025-12-05 17:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb0%252Fe5b0a099c3c0b1c504765d62d9894d69%252Fpa%252FNR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg saved to cache
2025-12-05 17:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 43c4493f-ee22-5f29-a228-726d2b149590
2025-12-05 17:09:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43c4493f-ee22-5f29-a228-726d2b149590, skipping ID generation
2025-12-05 17:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43c4493f-ee22-5f29-a228-726d2b149590 with scrape type 1
2025-12-05 17:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 43c4493f-ee22-5f29-a228-726d2b149590 from tracking dictionaries
2025-12-05 17:09:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43c4493f-ee22-5f29-a228-726d2b149590 sending to next pipeline
2025-12-05 17:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 43c4493f-ee22-5f29-a228-726d2b149590, identifier: NR98659
2025-12-05 17:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 43c4493f-ee22-5f29-a228-726d2b149590 with identifier: NR98659
2025-12-05 17:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 43c4493f-ee22-5f29-a228-726d2b149590 with identifier: NR98659
2025-12-05 17:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 43c4493f-ee22-5f29-a228-726d2b149590 with identifier: NR98659 to the API
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:34:46Z',
 'fuel_type': 'petrol',
 'id': '43c4493f-ee22-5f29-a228-726d2b149590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR98659',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Fiat',
 'model': '124 Spider',
 'odometer': 51718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_2af2b66dd701310eef649c0dad3f9099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_eaef3340093dd9c57f03245656f9c3cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_10685ea280a23140b0639486a34895c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_de632de5e69d2618af9d0803d4d90e7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_67655bb2567411b84f9997ac51a8496e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_6efc88a44a8466233a5d1695fb50088a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a234dc43c9bbb31b03c3b017ef58a2a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_fea85dc615ab4994585cfe9a400a0d82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_856478b2970c26ff684f11f5aa6e1cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_7e37a23492c66073a1342255ce81d1e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_a3473175c63614565828b31dba037974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_b8280288cafa812601da7d9f178b5363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_17e7efc8ea3aa3726eb2e49b6f85d76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_9ac511a4dd4da0d817c51afddcfbb05b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_3f7b0831188e3f866590ec16491527ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43c4493f-ee22-5f29-a228-726d2b149590/43c4493f-ee22-5f29-a228-726d2b149590_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b0/e5b0a099c3c0b1c504765d62d9894d69/pa/NR98659_44c9051ecee9a41edd81ef6025c04391.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat 124 Spider 1.4 Turbo Lusso',
 'transmission': 'manual',
 'trim': 'Lusso',
 'year': 2016}
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR98659%27 HTTP/1.1" 200 None
2025-12-05 17:09:35 [auto1.es] INFO: Saving data for NR98659: {'created_time': 1764954575.826838, 'last_price_update_time': 1764954575.826852, 'auction_closing_time': 1765038886.0}
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NR98659') HTTP/1.1" 204 0
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_f6075722d407547358c062ce925459c2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_cc8ff68b4a2503be4589f9c5563c97b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_4975c092895eb78af5ef47c5bc538a7d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_4975c092895eb78af5ef47c5bc538a7d.jpg not downloaded yet
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_e2f5b038f03c3e713b153f02e89f6964.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e59086548db174cab4b60dbff41dfdad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_16dee9dbfaa2c5b4d01e8306deb57a27.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_11bac042b66ebf808e9982b55f471703.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN73910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_6bf1c4c687b2ec0d2a6715c79aa00b58.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_3a2094940cd122bb3575afa90d890723.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6f0b50>
2025-12-05 17:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_a6dbfdaf676b25cfb15b4ce86bfbec73.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_a6dbfdaf676b25cfb15b4ce86bfbec73.jpg saved to cache
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba2450>
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_d680476da87e98e665f69c58b2435620.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d680476da87e98e665f69c58b2435620.jpg saved to cache
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8ae5d0>
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_b06ef647e1e0a1d56abebf5efbb95510.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_b06ef647e1e0a1d56abebf5efbb95510.jpg saved to cache
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dba2290>
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_490aeea5b55ed137366f13f6de3aa851.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_490aeea5b55ed137366f13f6de3aa851.jpg saved to cache
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8ace10>
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_c2c10c76725b5c6774b9f95543f1fd47.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c2c10c76725b5c6774b9f95543f1fd47.jpg saved to cache
2025-12-05 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db86510>
2025-12-05 17:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_e4c119cd244b5329a81f5c6202d781a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e4c119cd244b5329a81f5c6202d781a5.jpg saved to cache
2025-12-05 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db79850>
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_897edeaf81f3caeae6bf2f719a51ae91.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_897edeaf81f3caeae6bf2f719a51ae91.jpg saved to cache
2025-12-05 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_2a17b7ee88d6dc182492299bf434811c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_d02343aa7096d2aae5ad5b36b308ae64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e71ce50>
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_f6075722d407547358c062ce925459c2.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_f6075722d407547358c062ce925459c2.jpg saved to cache
2025-12-05 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8a1190>
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_cc8ff68b4a2503be4589f9c5563c97b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_cc8ff68b4a2503be4589f9c5563c97b1.jpg saved to cache
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e72b550>
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_e2f5b038f03c3e713b153f02e89f6964.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_e2f5b038f03c3e713b153f02e89f6964.jpg saved to cache
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e6bbe10>
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_e59086548db174cab4b60dbff41dfdad.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e59086548db174cab4b60dbff41dfdad.jpg saved to cache
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dadfe50>
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_16dee9dbfaa2c5b4d01e8306deb57a27.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_16dee9dbfaa2c5b4d01e8306deb57a27.jpg saved to cache
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e729850>
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F42%252F37429e2b8f5edc9012f2c431c10d43de%252Fpa%252FPH08907_11bac042b66ebf808e9982b55f471703.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_11bac042b66ebf808e9982b55f471703.jpg saved to cache
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45
2025-12-05 17:09:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58415d3b-4093-5ac1-b7e5-e470e0c77f45, skipping ID generation
2025-12-05 17:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45 with scrape type 1
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 58415d3b-4093-5ac1-b7e5-e470e0c77f45 from tracking dictionaries
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58415d3b-4093-5ac1-b7e5-e470e0c77f45 sending to next pipeline
2025-12-05 17:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58415d3b-4093-5ac1-b7e5-e470e0c77f45, identifier: PH08907
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8a1ad0>
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_6bf1c4c687b2ec0d2a6715c79aa00b58.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_6bf1c4c687b2ec0d2a6715c79aa00b58.jpg saved to cache
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9b9690>
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F20%252Fb320f2d48e3eb93591e54c0d86afa8ff%252Fpa%252FPR65471_3a2094940cd122bb3575afa90d890723.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_3a2094940cd122bb3575afa90d890723.jpg saved to cache
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7eb07baf-d019-599a-8f7c-37db5a7695f3
2025-12-05 17:09:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7eb07baf-d019-599a-8f7c-37db5a7695f3, skipping ID generation
2025-12-05 17:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eb07baf-d019-599a-8f7c-37db5a7695f3 with scrape type 1
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7eb07baf-d019-599a-8f7c-37db5a7695f3 from tracking dictionaries
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7eb07baf-d019-599a-8f7c-37db5a7695f3 sending to next pipeline
2025-12-05 17:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7eb07baf-d019-599a-8f7c-37db5a7695f3, identifier: PR65471
2025-12-05 17:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58415d3b-4093-5ac1-b7e5-e470e0c77f45 with identifier: PH08907
2025-12-05 17:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58415d3b-4093-5ac1-b7e5-e470e0c77f45 with identifier: PH08907
2025-12-05 17:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166796 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166796
2025-12-05 17:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 58415d3b-4093-5ac1-b7e5-e470e0c77f45 spider: auto1.es
2025-12-05 17:09:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 58415d3b-4093-5ac1-b7e5-e470e0c77f45 due to rule: high_mileage_for_country.json, error: 166796 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166796
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6A',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2025-12-06T16:35:31Z',
 'fuel_type': 'diesel',
 'id': '58415d3b-4093-5ac1-b7e5-e470e0c77f45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH08907',
 'listing': 'auction',
 'location': 'ES, Sagunt, València',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 166796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_47bbaab28e8c0cbd18750ca92c2ff824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_f0d5d26511fccc24dc90cbdd35f0cec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d40c418dcdf4cd3011947313cea1f219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_9b72f90a8511faca955c371af3940816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6bd88e4d7bbe0453e3511a19835ab1e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_a791aee0c69cb39e79c0eba3bdc7f2f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_4f58729f02fa2ed5caaf6c14e2f9517e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_1320a27eebf3c360e97dde558b9332f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_80f8d0479f4b14b1d86fef73135dfd81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_6b5ad2ad9e3863047b5e195028718270.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_df15a28400fa57f1dd0d2fe3e9181ee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e59086548db174cab4b60dbff41dfdad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_d680476da87e98e665f69c58b2435620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_e4c119cd244b5329a81f5c6202d781a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_11bac042b66ebf808e9982b55f471703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58415d3b-4093-5ac1-b7e5-e470e0c77f45/58415d3b-4093-5ac1-b7e5-e470e0c77f45_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/42/37429e2b8f5edc9012f2c431c10d43de/pa/PH08907_16dee9dbfaa2c5b4d01e8306deb57a27.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH08907%27 HTTP/1.1" 200 None
2025-12-05 17:09:39 [auto1.es] INFO: Saving data for PH08907: {'created_time': 1764954579.971962, 'last_price_update_time': 1764954579.971974, 'auction_closing_time': 1765038931.0}
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH08907') HTTP/1.1" 204 0
2025-12-05 17:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7eb07baf-d019-599a-8f7c-37db5a7695f3 with identifier: PR65471
2025-12-05 17:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7eb07baf-d019-599a-8f7c-37db5a7695f3 with identifier: PR65471
2025-12-05 17:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7eb07baf-d019-599a-8f7c-37db5a7695f3 with identifier: PR65471 to the API
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_3a2094940cd122bb3575afa90d890723.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:23:34Z',
 'fuel_type': 'petrol',
 'id': '7eb07baf-d019-599a-8f7c-37db5a7695f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR65471',
 'listing': 'auction',
 'location': 'ES, Alzira',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 48300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_36364a1f4b0d08fd45b3d51e7c97615d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_d01f04c2b110f2c956b04e1affdd7f58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_0d8704c9f77c99d1677618965ac758b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_2864486c18238e3ff8984d7cec31204d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_6ab3b2b052a30b6ad129b8a3f42bedc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_ce82e8c182836fc41a5873f1d605d250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_14a1c0e295b16ba4110a1d8ad39ce01d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_74f83d2fb027e40c56d2eda8529dcec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_1a1dda4f97a624e8bdbee390fc582952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_50e6939ac325f91b3e3129061be6cc3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_25d7ee2fec06a4b7d2d9832404ac29fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_f6075722d407547358c062ce925459c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_a6dbfdaf676b25cfb15b4ce86bfbec73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_897edeaf81f3caeae6bf2f719a51ae91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_cc8ff68b4a2503be4589f9c5563c97b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb07baf-d019-599a-8f7c-37db5a7695f3/7eb07baf-d019-599a-8f7c-37db5a7695f3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320f2d48e3eb93591e54c0d86afa8ff/pa/PR65471_3a2094940cd122bb3575afa90d890723.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2023}
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR65471%27 HTTP/1.1" 200 None
2025-12-05 17:09:40 [auto1.es] INFO: Saving data for PR65471: {'created_time': 1764954580.360611, 'last_price_update_time': 1764954580.360621, 'auction_closing_time': 1765038214.0}
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PR65471') HTTP/1.1" 204 0
2025-12-05 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c380e9c5ff8603a95e994b5501e1f026.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_4975c092895eb78af5ef47c5bc538a7d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66905ef490>
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F55%252Fe85546e198197dc8e6b4f983548674b3%252Fpa%252FXJ09621_2a17b7ee88d6dc182492299bf434811c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_2a17b7ee88d6dc182492299bf434811c.jpg saved to cache
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51fea56f-7ea9-528f-8e5a-96c620f84512
2025-12-05 17:09:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51fea56f-7ea9-528f-8e5a-96c620f84512, skipping ID generation
2025-12-05 17:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51fea56f-7ea9-528f-8e5a-96c620f84512 with scrape type 1
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 51fea56f-7ea9-528f-8e5a-96c620f84512 from tracking dictionaries
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51fea56f-7ea9-528f-8e5a-96c620f84512 sending to next pipeline
2025-12-05 17:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51fea56f-7ea9-528f-8e5a-96c620f84512, identifier: XJ09621
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5850d0>
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_d02343aa7096d2aae5ad5b36b308ae64.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_d02343aa7096d2aae5ad5b36b308ae64.jpg saved to cache
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51fea56f-7ea9-528f-8e5a-96c620f84512 with identifier: XJ09621
2025-12-05 17:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51fea56f-7ea9-528f-8e5a-96c620f84512 with identifier: XJ09621
2025-12-05 17:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51fea56f-7ea9-528f-8e5a-96c620f84512 with identifier: XJ09621 to the API
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_2a17b7ee88d6dc182492299bf434811c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:04:14Z',
 'fuel_type': 'diesel',
 'id': '51fea56f-7ea9-528f-8e5a-96c620f84512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ09621',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 56703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35036,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a423742004d71256b1679e58cf9e35bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35036,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_10420cf2933c1a4cd10d02b988166cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30779,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_a6924178672e20a80b8beee279fd376d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30779,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_57f6735fd8c69dfdd1458e51b2739dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33753,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_003eda7972fc85e62627efeabbc9e2cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33753,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_82f28dcf498bd17b2e735885765c5961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35888,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_d1f12769633ec0fa3d55139024fc9c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35888,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_49a7c2a77ddd7728a6c01a1eb32219ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67485,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_2a17b7ee88d6dc182492299bf434811c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67485,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_b2a060a0e5e79785609e8695421e099a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32630,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_ca5e6538a1e8939c221cc2aa955c7d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fea56f-7ea9-528f-8e5a-96c620f84512/51fea56f-7ea9-528f-8e5a-96c620f84512_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62737,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/55/e85546e198197dc8e6b4f983548674b3/pa/XJ09621_4725b97e9350880fc30b7ecdb7a86eb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ09621%27 HTTP/1.1" 200 None
2025-12-05 17:09:41 [auto1.es] INFO: Saving data for XJ09621: {'created_time': 1764954581.331111, 'last_price_update_time': 1764954581.331121, 'auction_closing_time': 1765037054.0}
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ09621') HTTP/1.1" 204 0
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e46bdd0>
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_c380e9c5ff8603a95e994b5501e1f026.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c380e9c5ff8603a95e994b5501e1f026.jpg saved to cache
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e7e1910>
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F30%252Fef3061a1fd7857d5d9c3e642bd68723d%252Fpa%252FDL02134_4975c092895eb78af5ef47c5bc538a7d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_4975c092895eb78af5ef47c5bc538a7d.jpg saved to cache
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 29645b1e-499c-5271-86d9-b6b9a0bb920a
2025-12-05 17:09:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29645b1e-499c-5271-86d9-b6b9a0bb920a, skipping ID generation
2025-12-05 17:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29645b1e-499c-5271-86d9-b6b9a0bb920a with scrape type 1
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 29645b1e-499c-5271-86d9-b6b9a0bb920a from tracking dictionaries
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29645b1e-499c-5271-86d9-b6b9a0bb920a sending to next pipeline
2025-12-05 17:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29645b1e-499c-5271-86d9-b6b9a0bb920a, identifier: DL02134
2025-12-05 17:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29645b1e-499c-5271-86d9-b6b9a0bb920a with identifier: DL02134
2025-12-05 17:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29645b1e-499c-5271-86d9-b6b9a0bb920a with identifier: DL02134
2025-12-05 17:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168828 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168828
2025-12-05 17:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29645b1e-499c-5271-86d9-b6b9a0bb920a spider: auto1.es
2025-12-05 17:09:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 29645b1e-499c-5271-86d9-b6b9a0bb920a due to rule: high_mileage_for_country.json, error: 168828 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168828
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:23:22Z',
 'fuel_type': 'hybrid',
 'id': '29645b1e-499c-5271-86d9-b6b9a0bb920a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL02134',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 168828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31658,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_926015240d814be2dcf66202f37f3788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31658,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_49acc763905b64602fe8755062527834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34779,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_36fdaa6acb90a9b3c3baf3b048c79c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34779,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_f5f92026fbbf4d2999943b0129b29b46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38026,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_b06ef647e1e0a1d56abebf5efbb95510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38026,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c2c10c76725b5c6774b9f95543f1fd47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33435,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_490aeea5b55ed137366f13f6de3aa851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33435,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_e2f5b038f03c3e713b153f02e89f6964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71366,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_6bf1c4c687b2ec0d2a6715c79aa00b58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71366,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_d02343aa7096d2aae5ad5b36b308ae64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26220,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_c380e9c5ff8603a95e994b5501e1f026.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29645b1e-499c-5271-86d9-b6b9a0bb920a/29645b1e-499c-5271-86d9-b6b9a0bb920a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54982,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/30/ef3061a1fd7857d5d9c3e642bd68723d/pa/DL02134_4975c092895eb78af5ef47c5bc538a7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 50 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL02134%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [auto1.es] INFO: Saving data for DL02134: {'created_time': 1764954582.172097, 'last_price_update_time': 1764954582.172107, 'auction_closing_time': 1765038202.0}
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL02134') HTTP/1.1" 204 0
2025-12-05 17:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN11011> (referer: https://www.auto1.com/v1/car-details-view/ZN11011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG46057> (referer: https://www.auto1.com/v1/car-details-view/EG46057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd35ddd9-a4d7-5135-860f-ba01004aee8e with identifier: ZN11011
2025-12-05 17:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd35ddd9-a4d7-5135-860f-ba01004aee8e with scrape type 1
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_bd1b316218da55691399dd38ecba92b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_bd1b316218da55691399dd38ecba92b4.jpg not downloaded yet
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_8c1d8e89b4cea883f13c523033e2022c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_8c1d8e89b4cea883f13c523033e2022c.jpg not downloaded yet
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_0b2d7c6a8672d14806c5cc0ea03e15a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_0b2d7c6a8672d14806c5cc0ea03e15a5.jpg not downloaded yet
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_49510c5704a9d5d9b1e5436b1dd911bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_49510c5704a9d5d9b1e5436b1dd911bc.jpg not downloaded yet
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_4bfb592b80e5a7b0c8bc186115872303.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_4bfb592b80e5a7b0c8bc186115872303.jpg not downloaded yet
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_80d76c0716931edd5aa40bcbed9ed31f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_80d76c0716931edd5aa40bcbed9ed31f.jpg not downloaded yet
2025-12-05 17:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc with identifier: EG46057
2025-12-05 17:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc with scrape type 1
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_19f482ec969365d9e55dfb3d87eef134.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_6258f37eebf81eb91e3e31222cb30a10.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_afd967002e559a5055ce65133b10ae27.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_473d36bd194936e44d654b2fa828cf2b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_616b143928c10df39a8f7dbac371e9fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_6b66c60bcc152af98420e04f57f49a34.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_8551b43103449d40662d305863343f8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_3ce58beb14d466430e40bfbb9570ee19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_dad648fa644de6d54cf7e2e80465ec23.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg already downloaded
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F12%252Ffc1226df257c0572bc2f3b35a8663ff4%252Fpa%252FEG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg already downloaded
2025-12-05 17:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc, identifier: EG46057
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_21d5e48081286945f5157569430f0a73.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_21d5e48081286945f5157569430f0a73.jpg not downloaded yet
2025-12-05 17:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc with identifier: EG46057
2025-12-05 17:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc with identifier: EG46057
2025-12-05 17:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 46938, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg46057', 'expiration_date': '2025-12-06t16:37:54z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg'], 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': 'e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94335}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87343}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84521}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74337}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89640}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85947}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80416}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91817}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74990}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83611}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76497}], 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 46938}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': 'rental',
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:37:54z',
     'fuel_type': 'petrol',
     'id': 'e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg46057',
     'listing': 'auction',
     'location': 'es, madrid',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 46938,
     'odometer_in_km': 46938,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 94335,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87343,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 84521,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87385,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74337,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89640,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82633,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85947,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92431,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65860,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80416,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75694,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 91817,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74990,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83611,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76497,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
2025-12-05 17:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc spider: auto1.es
2025-12-05 17:09:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 46938, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg46057', 'expiration_date': '2025-12-06t16:37:54z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg', 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg'], 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': 'e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94335}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87343}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84521}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74337}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89640}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85947}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80416}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91817}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74990}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83611}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76497}], 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 46938}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': 'rental',
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2025-12-06t16:37:54z',
     'fuel_type': 'petrol',
     'id': 'e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg46057',
     'listing': 'auction',
     'location': 'es, madrid',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 46938,
     'odometer_in_km': 46938,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg',
                    'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 94335,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87343,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 84521,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 87385,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74337,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89640,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82633,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85947,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92431,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65860,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80416,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75694,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 91817,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74990,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83611,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76497,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:37:54Z',
 'fuel_type': 'petrol',
 'id': 'e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG46057',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 46938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg',
                'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_19f482ec969365d9e55dfb3d87eef134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_89ce3ae5dde0c19f1f3772d6972e8106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6258f37eebf81eb91e3e31222cb30a10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_9b5a7cb83fc3cea87c6288009ff972a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_afd967002e559a5055ce65133b10ae27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_473d36bd194936e44d654b2fa828cf2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_a7accb1546e6eeded7225d2ad7dcae72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_616b143928c10df39a8f7dbac371e9fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_6b66c60bcc152af98420e04f57f49a34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_2b5ec9e211f64cc00d77467ae1dcd2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_8551b43103449d40662d305863343f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3045a515b81e8b2c25e081e09aa23d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_3ce58beb14d466430e40bfbb9570ee19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_ebcf5c2be4434bf45d344e2b3fbb6b1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_dad648fa644de6d54cf7e2e80465ec23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc/e135a4b6-e94f-5cf4-bf80-ec6a1ab093bc_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/12/fc1226df257c0572bc2f3b35a8663ff4/pa/EG46057_0e12a32fde8030ba4fc9e65fc4e22f0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG46057%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [auto1.es] INFO: Saving data for EG46057: {'created_time': 1764954583.010535, 'last_price_update_time': 1764954583.010544, 'auction_closing_time': 1765039074.0}
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG46057') HTTP/1.1" 204 0
2025-12-05 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_bd1b316218da55691399dd38ecba92b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_49510c5704a9d5d9b1e5436b1dd911bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_8c1d8e89b4cea883f13c523033e2022c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_0b2d7c6a8672d14806c5cc0ea03e15a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_a6b26d4c4969ebb1df1c61faae039c60.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_a6b26d4c4969ebb1df1c61faae039c60.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_ed8ec700497a56b5bdd9d926d9bab366.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_ed8ec700497a56b5bdd9d926d9bab366.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_25c4c03a12069a07be71ebbcabca7e2c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_25c4c03a12069a07be71ebbcabca7e2c.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_366ae611320c1d9b33c076199f0bfdab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_366ae611320c1d9b33c076199f0bfdab.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_89e7df525427aa28f4803850b52493ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_89e7df525427aa28f4803850b52493ed.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_10eeeff9816066e8e9f97d88fb405db9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_10eeeff9816066e8e9f97d88fb405db9.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_35dbe525587cce2d9971245d16c9e9ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_35dbe525587cce2d9971245d16c9e9ea.jpg not downloaded yet
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_fc3f9124eb426fbaf0b3b115de48686c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_fc3f9124eb426fbaf0b3b115de48686c.jpg not downloaded yet
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e74f9d0>
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_bd1b316218da55691399dd38ecba92b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_bd1b316218da55691399dd38ecba92b4.jpg saved to cache
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dc22d10>
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_49510c5704a9d5d9b1e5436b1dd911bc.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_49510c5704a9d5d9b1e5436b1dd911bc.jpg saved to cache
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d995a90>
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_8c1d8e89b4cea883f13c523033e2022c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_8c1d8e89b4cea883f13c523033e2022c.jpg saved to cache
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d998f90>
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_0b2d7c6a8672d14806c5cc0ea03e15a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_0b2d7c6a8672d14806c5cc0ea03e15a5.jpg saved to cache
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_094133d01406afa70c422b1c96dce60b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_094133d01406afa70c422b1c96dce60b.jpg not downloaded yet
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG59071> (referer: https://www.auto1.com/v1/car-details-view/WG59071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_366ae611320c1d9b33c076199f0bfdab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_4bfb592b80e5a7b0c8bc186115872303.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_ed8ec700497a56b5bdd9d926d9bab366.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_80d76c0716931edd5aa40bcbed9ed31f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_21d5e48081286945f5157569430f0a73.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_89e7df525427aa28f4803850b52493ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_a6b26d4c4969ebb1df1c61faae039c60.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_25c4c03a12069a07be71ebbcabca7e2c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_10eeeff9816066e8e9f97d88fb405db9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_35dbe525587cce2d9971245d16c9e9ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2025-12-05 17:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with scrape type 2
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with scrape type 2
2025-12-05 17:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b, identifier: WG59071
2025-12-05 17:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2025-12-05 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2025-12-05 17:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071 to the API
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG59071>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:40:56Z',
 'fuel_type': 'diesel',
 'id': 'e1af7fb0-b7e0-547e-9d3e-754b8837bd8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG59071',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 112361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2025-12-05 17:09:44 [auto1.es] INFO: Saving data for WG59071: {'auction_closing_time': 1765039256.0, 'created_time': 1762840868.57209, 'last_price_update_time': 1764954584.636389}
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG59071') HTTP/1.1" 204 0
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_fc3f9124eb426fbaf0b3b115de48686c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_094133d01406afa70c422b1c96dce60b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e45b210>
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_366ae611320c1d9b33c076199f0bfdab.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_366ae611320c1d9b33c076199f0bfdab.jpg saved to cache
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc3810>
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_4bfb592b80e5a7b0c8bc186115872303.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_4bfb592b80e5a7b0c8bc186115872303.jpg saved to cache
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc1ad0>
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_ed8ec700497a56b5bdd9d926d9bab366.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_ed8ec700497a56b5bdd9d926d9bab366.jpg saved to cache
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e5d7a50>
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_80d76c0716931edd5aa40bcbed9ed31f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_80d76c0716931edd5aa40bcbed9ed31f.jpg saved to cache
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e589710>
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_21d5e48081286945f5157569430f0a73.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_21d5e48081286945f5157569430f0a73.jpg saved to cache
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d89ad90>
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_89e7df525427aa28f4803850b52493ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_89e7df525427aa28f4803850b52493ed.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbc3690>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_a6b26d4c4969ebb1df1c61faae039c60.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_a6b26d4c4969ebb1df1c61faae039c60.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e827cd0>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_25c4c03a12069a07be71ebbcabca7e2c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_25c4c03a12069a07be71ebbcabca7e2c.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48e490>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_10eeeff9816066e8e9f97d88fb405db9.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_10eeeff9816066e8e9f97d88fb405db9.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668db6dd90>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_35dbe525587cce2d9971245d16c9e9ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_35dbe525587cce2d9971245d16c9e9ea.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e65a4d0>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_fc3f9124eb426fbaf0b3b115de48686c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_fc3f9124eb426fbaf0b3b115de48686c.jpg saved to cache
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d8b5990>
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F29%252F3c2928530b1ec8e863b07fe8c2a32289%252Fpa%252FZN11011_094133d01406afa70c422b1c96dce60b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_094133d01406afa70c422b1c96dce60b.jpg saved to cache
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fd35ddd9-a4d7-5135-860f-ba01004aee8e
2025-12-05 17:09:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd35ddd9-a4d7-5135-860f-ba01004aee8e, skipping ID generation
2025-12-05 17:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd35ddd9-a4d7-5135-860f-ba01004aee8e with scrape type 1
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fd35ddd9-a4d7-5135-860f-ba01004aee8e from tracking dictionaries
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd35ddd9-a4d7-5135-860f-ba01004aee8e sending to next pipeline
2025-12-05 17:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd35ddd9-a4d7-5135-860f-ba01004aee8e, identifier: ZN11011
2025-12-05 17:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd35ddd9-a4d7-5135-860f-ba01004aee8e with identifier: ZN11011
2025-12-05 17:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd35ddd9-a4d7-5135-860f-ba01004aee8e with identifier: ZN11011
2025-12-05 17:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd35ddd9-a4d7-5135-860f-ba01004aee8e with identifier: ZN11011 to the API
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_094133d01406afa70c422b1c96dce60b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-06T16:03:07Z',
 'fuel_type': 'petrol',
 'id': 'fd35ddd9-a4d7-5135-860f-ba01004aee8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN11011',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'BMW',
 'model': '3er',
 'odometer': 47461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_bd1b316218da55691399dd38ecba92b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_8c1d8e89b4cea883f13c523033e2022c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_0b2d7c6a8672d14806c5cc0ea03e15a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_49510c5704a9d5d9b1e5436b1dd911bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_4bfb592b80e5a7b0c8bc186115872303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_80d76c0716931edd5aa40bcbed9ed31f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_21d5e48081286945f5157569430f0a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_a6b26d4c4969ebb1df1c61faae039c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_ed8ec700497a56b5bdd9d926d9bab366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_25c4c03a12069a07be71ebbcabca7e2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_366ae611320c1d9b33c076199f0bfdab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_89e7df525427aa28f4803850b52493ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_10eeeff9816066e8e9f97d88fb405db9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_35dbe525587cce2d9971245d16c9e9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_fc3f9124eb426fbaf0b3b115de48686c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd35ddd9-a4d7-5135-860f-ba01004aee8e/fd35ddd9-a4d7-5135-860f-ba01004aee8e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/29/3c2928530b1ec8e863b07fe8c2a32289/pa/ZN11011_094133d01406afa70c422b1c96dce60b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN11011%27 HTTP/1.1" 200 None
2025-12-05 17:09:47 [auto1.es] INFO: Saving data for ZN11011: {'created_time': 1764954587.841069, 'last_price_update_time': 1764954587.841078, 'auction_closing_time': 1765036987.0}
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN11011') HTTP/1.1" 204 0
2025-12-05 17:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN73910> (referer: https://www.auto1.com/v1/car-details-view/ZN73910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193fb574-23d4-58b3-8681-4effffea080a with identifier: ZN73910
2025-12-05 17:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193fb574-23d4-58b3-8681-4effffea080a with scrape type 1
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_ee87c279ccbd2890c4943ce3289708bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_ee87c279ccbd2890c4943ce3289708bd.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_63f7457d3f9794f8d62347fd30f0fa84.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_63f7457d3f9794f8d62347fd30f0fa84.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_4f65d47c125ece3a03123ccd055bb3dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_4f65d47c125ece3a03123ccd055bb3dc.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_48bcb6f72e3900c035a9b67983d7e4e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_48bcb6f72e3900c035a9b67983d7e4e7.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_619ef8b660970b9b795676f3feb20731.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_619ef8b660970b9b795676f3feb20731.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_390a40bb8a9b21e834440babbedbe2d8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_390a40bb8a9b21e834440babbedbe2d8.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_17a32651af14455cf9fc4b34b4bd12fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_17a32651af14455cf9fc4b34b4bd12fe.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_221b59ad2141a2b86a76cc691ac53a7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_221b59ad2141a2b86a76cc691ac53a7e.jpg not downloaded yet
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_ee87c279ccbd2890c4943ce3289708bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_cc0545f2166627680b16d16dbd6c831b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_cc0545f2166627680b16d16dbd6c831b.jpg not downloaded yet
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_48bcb6f72e3900c035a9b67983d7e4e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_4f65d47c125ece3a03123ccd055bb3dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_bef2f9276e64128ab95706f9b22ac2e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_bef2f9276e64128ab95706f9b22ac2e0.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg not downloaded yet
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_d08803a5c3149e64490deca18ace599f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_d08803a5c3149e64490deca18ace599f.jpg not downloaded yet
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_390a40bb8a9b21e834440babbedbe2d8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_8441ab80f875d1566114e523fb175953.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_8441ab80f875d1566114e523fb175953.jpg not downloaded yet
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_17a32651af14455cf9fc4b34b4bd12fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_221b59ad2141a2b86a76cc691ac53a7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_619ef8b660970b9b795676f3feb20731.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_b7a0267439d130d0b2ed6aa0cb484654.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_b7a0267439d130d0b2ed6aa0cb484654.jpg not downloaded yet
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_bef2f9276e64128ab95706f9b22ac2e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_cc0545f2166627680b16d16dbd6c831b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e61aa90>
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_ee87c279ccbd2890c4943ce3289708bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_ee87c279ccbd2890c4943ce3289708bd.jpg saved to cache
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_d08803a5c3149e64490deca18ace599f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_8441ab80f875d1566114e523fb175953.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_b7a0267439d130d0b2ed6aa0cb484654.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_63f7457d3f9794f8d62347fd30f0fa84.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d741f10>
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_48bcb6f72e3900c035a9b67983d7e4e7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_48bcb6f72e3900c035a9b67983d7e4e7.jpg saved to cache
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9ba510>
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_4f65d47c125ece3a03123ccd055bb3dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_4f65d47c125ece3a03123ccd055bb3dc.jpg saved to cache
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d95eb50>
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_390a40bb8a9b21e834440babbedbe2d8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_390a40bb8a9b21e834440babbedbe2d8.jpg saved to cache
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e481b90>
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_17a32651af14455cf9fc4b34b4bd12fe.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_17a32651af14455cf9fc4b34b4bd12fe.jpg saved to cache
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9019d0>
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_221b59ad2141a2b86a76cc691ac53a7e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_221b59ad2141a2b86a76cc691ac53a7e.jpg saved to cache
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668dbb0ad0>
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_619ef8b660970b9b795676f3feb20731.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_619ef8b660970b9b795676f3feb20731.jpg saved to cache
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e555110>
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_bef2f9276e64128ab95706f9b22ac2e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_bef2f9276e64128ab95706f9b22ac2e0.jpg saved to cache
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f669061acd0>
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_cc0545f2166627680b16d16dbd6c831b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_cc0545f2166627680b16d16dbd6c831b.jpg saved to cache
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fd790>
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_d08803a5c3149e64490deca18ace599f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_d08803a5c3149e64490deca18ace599f.jpg saved to cache
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48f9d0>
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_8441ab80f875d1566114e523fb175953.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_8441ab80f875d1566114e523fb175953.jpg saved to cache
2025-12-05 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d9fd350>
2025-12-05 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_b7a0267439d130d0b2ed6aa0cb484654.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_b7a0267439d130d0b2ed6aa0cb484654.jpg saved to cache
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668d902390>
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_63f7457d3f9794f8d62347fd30f0fa84.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_63f7457d3f9794f8d62347fd30f0fa84.jpg saved to cache
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f668e48ee10>
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F4f%252Fac4ffe3d5f4cf5bc93f1bc7ef44e46df%252Fpa%252FZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg saved to cache
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 193fb574-23d4-58b3-8681-4effffea080a
2025-12-05 17:09:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 193fb574-23d4-58b3-8681-4effffea080a, skipping ID generation
2025-12-05 17:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193fb574-23d4-58b3-8681-4effffea080a with scrape type 1
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 193fb574-23d4-58b3-8681-4effffea080a from tracking dictionaries
2025-12-05 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 193fb574-23d4-58b3-8681-4effffea080a sending to next pipeline
2025-12-05 17:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 193fb574-23d4-58b3-8681-4effffea080a, identifier: ZN73910
2025-12-05 17:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 193fb574-23d4-58b3-8681-4effffea080a with identifier: ZN73910
2025-12-05 17:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 193fb574-23d4-58b3-8681-4effffea080a with identifier: ZN73910
2025-12-05 17:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 193fb574-23d4-58b3-8681-4effffea080a with identifier: ZN73910 to the API
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 325,
 'expiration_date': '2025-12-06T16:33:28Z',
 'fuel_type': 'electro',
 'id': '193fb574-23d4-58b3-8681-4effffea080a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN73910',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 8145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_ee87c279ccbd2890c4943ce3289708bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_63f7457d3f9794f8d62347fd30f0fa84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_4f65d47c125ece3a03123ccd055bb3dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_48bcb6f72e3900c035a9b67983d7e4e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_619ef8b660970b9b795676f3feb20731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_390a40bb8a9b21e834440babbedbe2d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_17a32651af14455cf9fc4b34b4bd12fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_221b59ad2141a2b86a76cc691ac53a7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_cc0545f2166627680b16d16dbd6c831b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_bef2f9276e64128ab95706f9b22ac2e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_0c8f20dcc28a463fef857df21ca9b8f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_d08803a5c3149e64490deca18ace599f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_8441ab80f875d1566114e523fb175953.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_193fb574-23d4-58b3-8681-4effffea080a/193fb574-23d4-58b3-8681-4effffea080a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/4f/ac4ffe3d5f4cf5bc93f1bc7ef44e46df/pa/ZN73910_b7a0267439d130d0b2ed6aa0cb484654.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia EV6 electric drive 239 kW GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2024}
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN73910%27 HTTP/1.1" 200 None
2025-12-05 17:09:53 [auto1.es] INFO: Saving data for ZN73910: {'created_time': 1764954593.084158, 'last_price_update_time': 1764954593.084167, 'auction_closing_time': 1765038808.0}
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN73910') HTTP/1.1" 204 0
2025-12-05 17:10:08 [scrapy.extensions.logstats] INFO: Crawled 784 pages (at 17 pages/min), scraped 233 items (at 9 items/min)
2025-12-05 17:11:08 [scrapy.extensions.logstats] INFO: Crawled 784 pages (at 0 pages/min), scraped 233 items (at 0 items/min)
2025-12-05 17:11:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.519(s), this was the 1st time calling it.
2025-12-05 17:11:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9603656916182435 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 17:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 17:11:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.354(s), this was the 1st time calling it.
2025-12-05 17:11:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.179083771254834 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 17:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT96929> (referer: https://www.auto1.com/v1/car-details-view/WT96929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7f7f49-242c-5066-87db-5824d7ce10c7 with identifier: WT96929
2025-12-05 17:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7f7f49-242c-5066-87db-5824d7ce10c7 with scrape type 2
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d7f7f49-242c-5066-87db-5824d7ce10c7 with scrape type 2
2025-12-05 17:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d7f7f49-242c-5066-87db-5824d7ce10c7, identifier: WT96929
2025-12-05 17:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d7f7f49-242c-5066-87db-5824d7ce10c7 with identifier: WT96929
2025-12-05 17:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d7f7f49-242c-5066-87db-5824d7ce10c7 with identifier: WT96929
2025-12-05 17:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2025-12-05 17:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9d7f7f49-242c-5066-87db-5824d7ce10c7 spider: auto1.es
2025-12-05 17:11:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9d7f7f49-242c-5066-87db-5824d7ce10c7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:52:50Z',
 'fuel_type': 'diesel',
 'id': '9d7f7f49-242c-5066-87db-5824d7ce10c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT96929',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 147146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2020}
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT96929%27 HTTP/1.1" 200 None
2025-12-05 17:11:37 [auto1.es] INFO: Saving data for WT96929: {'auction_closing_time': 1765039970.0, 'created_time': 1764003789.143743, 'last_price_update_time': 1764954697.423731}
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WT96929') HTTP/1.1" 204 0
2025-12-05 17:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 17:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB37326> (referer: https://www.auto1.com/v1/car-details-view/EB37326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1348c345-3ff8-5adc-b6d5-280ce7707f98 with identifier: EB37326
2025-12-05 17:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1348c345-3ff8-5adc-b6d5-280ce7707f98 with scrape type 2
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1348c345-3ff8-5adc-b6d5-280ce7707f98 with scrape type 2
2025-12-05 17:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1348c345-3ff8-5adc-b6d5-280ce7707f98, identifier: EB37326
2025-12-05 17:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1348c345-3ff8-5adc-b6d5-280ce7707f98 with identifier: EB37326
2025-12-05 17:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1348c345-3ff8-5adc-b6d5-280ce7707f98 with identifier: EB37326
2025-12-05 17:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1348c345-3ff8-5adc-b6d5-280ce7707f98 with identifier: EB37326 to the API
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EB37326>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:09:45Z',
 'fuel_type': 'diesel',
 'id': '1348c345-3ff8-5adc-b6d5-280ce7707f98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB37326',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 135795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB37326%27 HTTP/1.1" 200 None
2025-12-05 17:11:45 [auto1.es] INFO: Saving data for EB37326: {'auction_closing_time': 1765037385.0, 'created_time': 1762362157.506255, 'last_price_update_time': 1764954705.078421}
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB37326') HTTP/1.1" 204 0
2025-12-05 17:11:45 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 17:11:45 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB20063%27 HTTP/1.1" 200 None
2025-12-05 17:11:45 [auto1.es] INFO: Saving data for NB20063: {'created_time': 1764954705.212426}
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NB20063') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201764522705 HTTP/1.1" 200 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AC30439') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AG10532') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AL55727') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AP44308') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AT16070') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BT09002') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BX24765') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CJ58925') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CL14168') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CP04909') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DB75337') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DR10729') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DT42441') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EK23268') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ES19217') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ET95519') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EX13755') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FF37688') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FK42893') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FL81877') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FP40332') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GA20530') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GC31041') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GC73616') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GE46645') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GH14514') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GL75649') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HB93442') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HF23928') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HJ35368') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HM09513') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HN40792') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HU22248') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JL09805') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JS90593') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KP88799') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KS24892') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LA40008') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MF42971') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ML36471') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NF93246') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NU64303') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PE23741') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PJ54874') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PM96586') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PV45725') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PX17411') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RB88759') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RP24593') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SL68555') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SM27151') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SM85341') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TB18792') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TH28461') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ53128') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UB10043') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UH34805') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VC75336') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ38426') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VU70419') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WT26775') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XX68980') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='YH63177') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='YT78283') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG28300') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ79064') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL56858') HTTP/1.1" 204 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN95076') HTTP/1.1" 204 0
2025-12-05 17:11:45 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (234 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_25_2025-12-05T17_00_00.jl
2025-12-05 17:11:45 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 3246239,
 'downloader/request_count': 1875,
 'downloader/request_method_count/GET': 1857,
 'downloader/request_method_count/POST': 18,
 'downloader/response_bytes': 91331918,
 'downloader/response_count': 1875,
 'downloader/response_status_count/200': 1875,
 'dupefilter/filtered': 24,
 'elapsed_time_seconds': 697.725643,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 17, 11, 45, 890045, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 149,
 'item_dropped_reasons_count/DropItem': 149,
 'item_scraped_count': 234,
 'log_count/DEBUG': 16635,
 'log_count/ERROR': 10,
 'log_count/INFO': 14963,
 'memusage/max': 164024320,
 'memusage/startup': 127336448,
 'photo_download_count': 1089,
 'request_depth_max': 20,
 'response_received_count': 786,
 'scheduler/dequeued': 1875,
 'scheduler/dequeued/memory': 1875,
 'scheduler/enqueued': 1875,
 'scheduler/enqueued/memory': 1875,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 788,
 'scrapy-zyte-api/error_ratio': 0.0025380710659898475,
 'scrapy-zyte-api/errors': 2,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 2,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.6836694266786925,
 'scrapy-zyte-api/mean_response_seconds': 4.69176296722209,
 'scrapy-zyte-api/processed': 786,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 786,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 785,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 786,
 'scrapy-zyte-api/request_args/httpRequestBody': 18,
 'scrapy-zyte-api/request_args/httpRequestMethod': 18,
 'scrapy-zyte-api/request_args/httpResponseBody': 786,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 786,
 'scrapy-zyte-api/request_args/sessionContext': 786,
 'scrapy-zyte-api/request_args/url': 786,
 'scrapy-zyte-api/status_codes/0': 2,
 'scrapy-zyte-api/status_codes/200': 786,
 'scrapy-zyte-api/success': 786,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 5, 17, 0, 8, 164402, tzinfo=datetime.timezone.utc)}
2025-12-05 17:11:45 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 17:11:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6690816590>
2025-12-05 17:11:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f66905804d0>

PROJECT (sourcing_v2), SPIDER (auto1.es)